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Abstract 


To  design  high  performance,  practically  implementable  control  laws,  it  is  important  to  have  the 
appropriate  tools  for  design  and  analysis.  These  tools  should  enable  the  following:  1.)  they  should 
be  based  on  robustness  theory  that  is  nonconservative  with  respect  to  the  type  of  uncertainty  being 
considered;  2.)  they  should  allow  performance  to  be  measured  in  a  meaningful  way;  3.)  they  should 
yield  controllers  that  are  of  sufficiently  low  order  to  be  implemented  on  control  processors  with 
limited  throughput  capabilities;  4.)  they  should  be  implemented  via  efficient  numerical  algorithms. 
The  research  cited  in  this  final  report  has  led  to  the  further  development  of  robustness  theories  and 
algorithms  which  include  phase  information  regarding  the  uncertainty.  In  addition,  this  research 
has  expanded  the  theory  of  optimal  and  suboptimal  reduced-order  control  design  and  led  to  the 
development  of  new  continuation  algorithms  for  H2  optimal  reduced-order  modeling  and  control 
based  on  the  optimal  projection  equations.  Finally,  a  new  fixed-structure  approach  to  complex 
structured  singular  value  controller  synthesis  has  been  developed.  This  approach  a  priori  constrains 
the  order  of  the  D-scales  in  the  optimization  process  and  can  lead  to  much  more  robust  controllers 
than  standard  D-K  iteration  and  curve  fitting  approaches. 
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1. 


Introduction 


To  design  high  performance,  practically  implementable  control  laws,  it  is  important  to  have 
the  appropriate  tools  for  design  and  analysis.  These  tools  should  enable  the  following: 

1.  They  should  be  based  on  robustness  theory  that  is  nonconservative  with  respect  to  the  type  of 
uncertainty  being  considered; 

2.  They  should  allow  performance  to  be  measured  in  a  meaningful  way; 

3.  They  should  yield  controllers  that  are  of  sufficiently  low  order  to  be  implemented  on  control 
processors  with  limited  throughput  capabilities; 

4.  They  should  be  implemented  via  efficient  numerical  algorithms. 

The  ultimate  aim  of  this  research  is  to  develop  control  design  and  analysis  tools  with  the  above 
characteristics. 

From  a  theoretical  perspective,  to  accomplish  nonconservatism  with  respect  to  real,  constant 
uncertainty  or  with  respect  to  systems  that  are  inherently  stable  (such  as  positive  real  systems), 
it  is  important  to  develop  robustness  theories  that  are  not  totally  dependent  on  norms.  This  is 
because  norm-based  tests  do  not  allow  the  inclusion  of  phase  information  regarding  the  uncertainty. 
These  theories  would  be  expected  to  deviate  significantly  from  the  popular  but  norm-based  small 
gain  tests. 

Often  times  in  the  design  of  controllers  for  flexible  structures,  higher  frequency  modes  are 
deleted  from  the  model  in  order  to  enable  the  design  of  lower  order  controllers.  The  unmodeled 
modes  are  then  accounted  for  as  unstructured  (i.e.,  magnitude  bounded  but  arbitrary  phase)  un¬ 
certainty.  If  the  unmodeled  dynamics  are  actually  fairy  well  known,  an  alternative  is  to  include 
them  in  the  control  design  model  and  design  a  reduced-order  controller.  The  low-order  controller 
can  be  designed  by  reducing  the  dimension  of  an  optimal  full-order  controller  or  by  direct  design 
(i.e.,  directly  optimizing  some  cost  function).  Hence,  in  this  design  process  the  structure  of  the 
controller  is  constrained  a  priori. 

Another  important  fixed-structure  problem  which  appears  in  robust  control  is  a  priori  constrain¬ 
ing  the  order  of  the  Z)-scales  in  complex  structured  singular  value  (CSSV)  controller  synthesis.  This 
robust  design  technique  enables  the  design  of  controllers  that  are  robust  with  respect  to  multiple 
block,  unstructured  uncertainty  and  also  guarantee  a  certain  measure  of  robust  performance.  How¬ 
ever,  current  techniques  for  CSSV  controller  synthesis  require  the  fitting  of  potentially  very  high 
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order  D-scales  with  lower  order  approximations  to  avoid  extremely  high  order  controllers.  This 
curve-fitting  step  can  be  very  suboptimal  and  can  even  lead  to  a  degradation  of  robust  stability 
and  performance  in  comparison  with  a  standard  Hoo  design.  This  highlights  the  importance  of 
developing  CSSV  controller  synthesis  techniques  that  optimize  the  2?-scales  subject  to  a  constraint 
on  the  Z)-scale  order. 

The  above  discussion  motivates  the  objectives  of  PIRC.  One  objective  was  to  extend  majorant 
analysis  to  handle  positive- real  systems  and  specialize  the  basic  theory  to  the  case  of  collocated, 
decentralized,  static  rate  feedback.  The  next  objective  was  to  extend  the  results  to  the  case  of 
collocated,  dynamic  rate  feedback.  In  addition,  we  desired  to  compare  the  positive  real  majorant 
bounds  with  a  totally  norm  based  majorant  bound  and  a  performance  bound  obtained  from  complex 
structured  singular  value  theory.  Finally,  we  aimed  to  extend  the  results  to  the  more  realistic  case 
in  which  the  sensor  and  actuater  dynamics  are  included  in  the  plant  model. 

Like  positive  real  majorant  theory,  Popov  theory  also  enables  the  incorporation  of  phase  infor¬ 
mation  regarding  the  uncertainty.  Our  consultant,  Dr.  Wassim  Haddad’s  first  objective  here  was 
to  extend  Popov  theory  to  handle  bidirectional  uncertainty  analysis.  We  also  desired  to  develop  a 
special-case  numerical  algorithm  to  implement  Popov  robustness  analysis.  Next,  we  aimed  to  de¬ 
velop  a  more  general  algorithm  and  apply  it  to  a  realistic  example.  Due  to  our  collaboration  with 
Dr.  Jonothan  How  at  MIT,  the  analysis  was  to  be  performed  using  the  Middeck  Active  Control 
Experiment  (MACE). 

The  development  of  Popov  robustness  theory  was  largely  motivated  by  the  early  work  of  Harris 
Corporation  in  Maximum  Entropy  control  design,  which  has  been  shown  empirically  to  non  conser¬ 
vatively  execute  the  design  of  robust  controllers  for  flexible  structures  with  modal  uncertainties. 
This  research  sought  to  develop  a  rigorous  theoretical  foundation  for  Maximum  Entropy  design  and 
also  to  develop  more  efficient  numerical  algorithms  for  Maximum  Entropy  design. 

An  additional  objective  of  this  research  was  to  develop  continuation  algorithms  for  optimal, 
reduced-order  control  design  based  on  the  optimal  projection  equations  as  opposed  to  the  gradient 
expressions.  Gradient-based  methods  directly  optimize  the  controller  parameters.  To  keep  the 
number  of  controller  parameters  from  becoming  too  large  the  controller  is  constrained  to  a  minimal 
parameter  basis.  However,  this  constraint  tends  to  introduce  numerical  ill-conditioning  since  the 
assumptions  behind  a  minimal  parameter  basis  are  not  always  satisfied  along  the  homotopy  path  or 
may  be  “poorly  satisfied.”  The  advantage  of  a  gradient-based  approach  is  that  it  easily  enables  the 
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development  of  “globally  convergent  homotopy  algorithms,”  i.e.,  homotopy  algorithms  for  which  a 
well-conditioned  homotopy  map  is  guaranteed  with  probability  one.  An  alternative  which  avoids 
the  ill-conditioning  due  to  the  controller  basis  constraint  is  to  develop  a  continuation  algorithm 
based  directly  on  the  optimal  projection  equations.  This  class  of  algorithms  does  not  currently  fit 
into  globally  convergent  homotopy  theory,  but  for  certain  problems  algorithms  of  this  type  can  be 
implemented  very  efficiently  and  have  exhibited  good  numerical  robustness. 

A  final  objective  of  this  research  was  to  develop  a  CSSV  controller  synthesis  technique  that 
constrains  the  order  of  the  Z)-scales  in  the  optimization  process.  This  research  has  the  potential  to 
significantly  impact  a  very  important  area  of  robust  control  design  by  developing  a  more  reliable 
and  optimal  CSSV  synthesis  process.  An  enumeration  of  the  research  objectives  is  given  below.  . 

Research  Objectives 

1.  For  the  case  of  uncertain,  strictly  positive  real  plants  controlled  by  positive  real  compensators, 
use  majorant  analysis  to  develop  frequency  domain  performance  bounds  that  are  less  conser¬ 
vative  than  previous  majorant  results.  Then  extend  these  results  to  the  more  realistic  case  of 
plants  with  sensor  and  actuater  dynamics. 

2.  Extend  recent  work  in  Popov  robustness  theory,  wherein  the  uncertainty  is  assumed  to  vary 
in  only  one  direction  (positive  or  negative),  so  that  the  uncertainty  is  allowed  to  vary  in  both 
directions. 

3.  Use  Lyapunov  functions  to  provide  a  more  rigorous  foundation  for  Maximum  Entropy  design, 

4.  Develop  a  continuation  algorithm  for  Maximum  Entropy  design  that  can  exhibit  quadratic 
convergence  properties  along  the  continuation  path. 

5.  Apply  and  compare  both  frequency  domain  and  state-space  versions  of  the  Popov  test  to  a 
benchmark  problem.  The  state-space  tests  were  to  be  applied  via  homotopy  algorithms. 

6.  Develop  a  general  algorithm  for  Popov  analysis  (with  bi-directional  uncertainty)  and  apply  it 
to  the  Middeck  Active  Control  Experiment  (MACE)  at  MIT. 

7.  To  better  understand  the  relationship  between  the  optimal  projection  equations  for  H2  optimal 
reduced-order  design  and  suboptimal  controller  reduction  methods,  extend  optimal  projection 
theory  to  the  case  in  which  the  controller  is  not  a  priori  assumed  to  be  minimal  (the  standard 
assumption  of  optimal  projection  theory).  Also,  compare  the  projections  used  by  the  subopti- 
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mal  methods  that  are  able  to  produce  a  minimal  realization  of  a  nonminimal  LQG  compensator 
with  the  optimal  projection. 

8.  To  aid  in  the  development  of  a  rigorous  initialization  technique  for  continuation  and  homotopy 
algorithms  for  H2  or  H2IH00  optimal  design,  develop  a  method  for  constructing  nearly  non¬ 
minimal  LQG  compensators. 

9.  As  a  step  in  developing  a  continuation  algorithm  for  H2  optimal  reduced-order  control  design 
using  the  optimal  projection  equations,  develop  a  continuation  algorithm  for  the  easier  problem 
of  H2  optimal  model  reduction  using  the  optimal  projection  equations. 

10.  Develop  a  continuation  algorithm  for  H2  optimal,  reduced-order  control  design. 

11.  As  a  foundation  for  CSSV  controller  synthesis  with  fixed-order  D-scales,  use  recent  H2IH00 
theory  to  develop  a  CSSV  analysis  technique  for  constant  D-scales  and  then  fixed-order  dynamic 
D-scales. 

12.  Develop  a  CSSV  controller  synthesis  technique  for  constant  D-scales. 
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3.  Frequency  Domain  Performance  Bounds  for  Uncertain  Positive  Real  Plants 
Controlled  by  Strictly  Positive  Real  Compensators  [2.6,  2.14,  2.20,  2.29] 

Many  of  the  developments  in  robustness  analysis  have  focused  exclusively  on  the  determination 
of  stability.  However,  in  practical  engineering,  performance  issues  are  paramount,  so  it  is  also 
important  to  determine  the  type  of  performance  degradation  that  occurs  due  to  uncertainty  in 
the  system  modebng.  A  common  feature  of  a  class  of  these  results  [3. 1-3.4]  is  that  they  rely  on 
majorant  bounding  techniques. 

In  [3. 1-3.4]  performance  bounding  is  measured  in  basically  three  ways.  References  [3.1]  and 
[3.2]  measure  performance  in  terms  of  second  order  statistics.  In  particular,  bounds  are  obtained  on 
the  steady-state  variances  of  selected  system  variables.  In  [3.3],  performance  is  expressed  in  terms 
of  the  frequency  response  of  selected  system  outputs.  This  result  led  to  a  new  upper  bound  for  the 
complex  structured  singular  value  [3.5].  Finally,  [3.4]  considers  the  transient  response  of  certain 
system  outputs,  a  performance  measure  which  had  not  previously  been  treated  in  the  robustness 
literature. 

A  common  feature  of  these  results  and  most  other  robustness  results,  with  the  possible  exception 
of  methods  based  on  extensions  of  Popov  analysis  and  parameter-dependent  Lyapunov  functions  is 
that  they  do  not  predict  unconditional  stability  for  feedback  systems  consisting  of  a  positive  real 
plant  controlled  by  a  strictly  positive  real  controller. 

This  research  uses  the  logarithmic  norm  in  the  context  of  majorant  analysis  to  develop  tests  for 
robust  stability  and  performance  that  predict  unconditional  stability  for  the  above  case  and  also 
yield  robust  performance  bounds.  As  in  [3.3],  this  result  considers  the  frequency  domain  behavior 
of  a  given  system.  The  results  are  specialized  to  the  case  of  static,  decentralized,  collocated  rate 
feedback  and  dynamic,  collocated  rate  feedback.  An  example  of  the  results  is  shown  in  Figure  3.1 
which  shows  the  performance  envelope  predicted  by  the  (new)  positive  real  majorant  analysis  and 
the  actual  variations  due  to  perturbations  in  the  lowest  natural  frequency.  For  this  case,  completely 
norm-based  majorant  analysis  [3.3]  and  complex  structured  singular  value  analysis  [3.5]  predicted 
instability.  Figure  3.2  compares  the  positive  real  majorant  bound  (PRMB)  with  the  complex  block- 
structure  majorant  bound  (CBSMB)  from  [3.3]  and  the  complex  structured  singular  value  bound 
(CSSVB)  derived  from  [3.5]  for  analysis  of  an  Euler- Bernouilli  beam  with  frequency  uncertainty. 
Notice  that  over  all  frequencies  PRMB  <  CBSMB  <  CSSVB. 
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These  results  have  been  extended  to  plants  with  sensor  and  actuater  dynamics.  Examples  have 

shown  similar  nonconservatism  to  that  described  above. 
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Figure  3.1.  Performance  Bound  for  Example  8.3  of  [2.1] 
(3  modes,  lowest  frequency  uncertain) 


Harris  Corporation 


11 


January  1995  00051.tex 


Magnitude 


Frequency  Hz 


Figure  3.2.  Comparison  of  PR  MB,  CBSMB,  and  CSSVB  for  Example  8.5  of  [2.1] 
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4.  Maximum  Entropy-Type  Lyapunov  Functions  for  Robust  Stability  and  Per¬ 
formance  Analysis  [2.1,  2.15] 

The  Maximum  Entropy  approach  to  robust  control  was  developed  to  address  the  problem  of 
modal  uncertainty  in  flexible  structures  [4.1-4.4].  The  rationale  for  this  approach  was  based  upon 
insights  from  the  statistical  analysis  of  lightly  damped  structures.  Despite  favorable  comparisons 
to  other  approaches  and  experimental  application,  the  basis  and  meaning  of  the  approach  remains 
mostly  empirical.  This  research  was  initiated  to  make  significant  progress  towards  developing  a 
rigorous  foundation  for  Maximum  Entropy  design. 

Besides  statistical  modal  analysis  techniques,  a  variety  of  formulations  have  been  put  forth  for 
justifying  the  Maximum  Entropy  approach.  To  reproduce  certain  covariance  phenomena  of  un¬ 
certain  multimodal  systems  (decorrelation,  incoherence,  and  equipartition)  a  multiplicative  white 
noise  model  was  invoked  [4.1,  4.2).  The  specific  model  chosen  was  interpreted  in  the  sense  of 
Stratonovich,  thus  entailing  a  critical  correction  term  in  the  covariance  equation  due  to  the  con¬ 
version  from  Stratonovich  to  Ito  calculus.  The  Stratonovich  model  was  itself  based  upon  a  limiting 
process  in  which  the  parameter  entropy  increased,  thus  suggesting  the  name  “Maximum  Entropy” 
control. 

An  alternative  justification  for  the  Maximum  Entropy  model  was  given  in  [4.5]  where  a  covari¬ 
ance  averaging  approach  was  used  to  show  that  if  the  state  covariance  is  averaged  over  uncertain 
modal  frequencies  possessing  a  Cauchy  distribution,  then  the  resulting  averaged  covariance  satisfies 
the  Maximum  Entropy  covariance  model. 

Although  the  various  formulations  of  Maximum  Entropy  theory  lend  considerable  insight  into 
the  nature  of  the  approach,  there  remains  a  significant  gap  between  this  approach  and  more  con¬ 
ventional  techniques,  such  as  Hqo  theory.  The  missing  link,  in  our  opinion,  is  the  lack  of  a  Lyapunov 
function  that  guarantees  the  robust  stability  of  the  closed-loop  control  system.  In  this  regard  it  was 
long  suspected  that  such  a  Lyapunov  function  would  be  unconventional,  that  is,  unlike  those  arising 
in  Hoo  theory.  This  view  arose  from  the  fact  that  the  Maximum  Entropy  controllers  were  often 
robust  to  large  perturbations  in  the  damped  natural  frequencies,  that  is,  the  imaginary  part  of  the 
eigenvalues.  Such  perturbations  are  highly  structured,  and  thus  are  often  treated  conservatively  by 
conventional  small-gain-type  bounds. 

This  research  provided  a  Lyapunov-function  basis  for  the  Maximum  Entropy  covariance  model 
for  the  case  of  modal  frequency  uncertainty.  In  fact,  in  this  special  case,  two  alternative  Lyapunov 
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functions  along  with  corresponding  performance  bounds  were  provided.  Each  Lyapunov  function 
involves  the  sum  of  two  matrices,  the  first  being  the  solution  to  the  Maximum  Entropy  equation, 
and  the  second  being  a  constant  auxiliary  portion.  The  construction  is  similar  to  the  parameter- 
dependent  Lyapunov  function  technique  developed  in  [4.6],  except  that  in  the  present  case  the 
auxiliary  portion  is  constant,  that  is,  independent  of  the  uncertainty. 

While  this  research  potentially  provides  a  Lyapunov  function  foundation  for  the  Maximum 
Entropy  control  approach,  our  results  are  currently  limited  to  open-loop  analysis.  An  illustration  of 
the  performance  bounds  predicted  by  the  Maximum  Entropy  Lyapunov  functions  is  given  in  Figure 

4.1  which  considers  a  one  mode  system  with  frequency  uncertainty.  Note  that  both  Maximum 
Entropy  performance  bounds  are  much  less  conservative  than  the  performance  bound  developed  in 
[4.7]. 
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Figure  4.1.  The  performance  bounds  based  on  the  Maximum  Entropy  Lyapunov 
functions  (labeled  (39)  and  (43)  were  much  less  conservative  than  the  performance  bound 
based  on  the  results  of  [4.7]  (labeled  Bernstein  &  Haddad) 
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5.  A  Homotopy  Algorithm  for  Maximum  Entropy  Design  [2.2,  2.16] 

The  linear-quadratic-guassian  (LQG)  compensator  has  been  developed  to  facilitate  the  design 
of  control  laws  for  complex,  multi-input  multi-output  (MIMO)  systems  such  as  flexible  structures. 
However,  it  is  well  known  that  an  LQG  compensator  can  yield  a  closed-loop  system  with  arbitrarily 
poor  performance  robustness  properties.  This  deficiency  has  led  to  generalizations  of  LQG  that 
allow  the  design  of  robust  controllers.  One  such  generalization  of  LQG  is  the  Maximum  Entropy 
control  design  approach  discussed  in  the  previous  section.  Although,  as  previously  mentioned,  the 
rigorous  theoretical  foundation  for  Maximum  Entropy  design  is  not  yet  complete,  it  has  proven  to 
be  an  effective  tool  in  the  design  of  robust  control  laws  for  ground-based  flexible  structure  testbeds 
[5.1,  5.2]  and  for  certain  benchmark  problems  [5.3,  5.4). 

The  computation  of  full-order  Maximum  Entropy  controllers  requires  the  solution  of  a  set  of 
equations  consisting  of  two  Riccati  equations  coupled  to  two  Lyapunov  equations.  If  the  uncertainty 
is  assumed  to  be  zero,  these  equations  decouple  and  the  Riccati  equations  become  the  standard 
LQG  Riccati  equations.  A  homotopy  algorithm  for  solving  these  equations  is  described  in  [5.5]. 
This  algorithm  is  based  on  first  solving  an  LQG  problem  and  gradually  increasing  the  uncertainty 
level  until  the  desired  degree  of  robustness  is  achieved.  Unfortunately,  the  algorithm  of  [5.5]  relies  on 
an  iterative  scheme  that  tends  to  have  increasingly  poor  convergence  properties  as  the  uncertainty 
level  is  increased. 

The  contribution  of  this  research  is  the  development  of  a  new  homotopy  algorithm  for  full- 
order  Maximum  Entropy  design.  The  algorithm  development  utilizes  the  results  of  [5.6].  Unlike 
the  previous  approach,  this  algorithm  has  quadratic  convergence  rates  along  the  homotopy  curve. 
The  algorithm  has  been  implemented  in  MATLAB  and  is  illustrated  using  a  single-input,  single¬ 
output  control  problem  for  the  ACES  testbed  at  NASA  Marshall  Space  Flight  Center  in  Huntsville, 
Alabama. 

The  Bode  plots  of  the  17th-order  open  loop  ACES  plant  are  shown  in  Figure  5.1.  The  basic 
control  objective  is  to  attenuate  the  lower  frecpiency  modes  of  the  structure  (i.e.,  the  modes  less 
than  3  Hz).  Each  of  the  flexible  modes  is  considered  uncertain.  The  magnitude  of  the  uncertainties 
is  determined  by  a  scalar  parameter  (/3). 
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Figure  5.1.  The  SISO  ACES  transfer  function  consisted  of  seven  distinct  modes 
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MAGNITUDE  OF  CONTROLLERS 


Figure  5.2.  The  frequency  response  of  the  Maximum  Entropy  Controllers  became 
increasingly  smooth  as  the  uncertainty  level  (proportional  to  /9)  was  increased 
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PHASE  OF  CONTROLLERS 


Figure  5.3.  The  phase  frequency  response  of  the  Maximum  Entropy  controllers  shows 
that  the  phase  becomes  positive  real  over  a  large  frequency  range  as  the  uncertainty 
level  (proportional  to  /3)  was  increased 
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For  this  example,  the  MATLAB  implementation  of  the  Maximum  Entropy  Homotopy  algorithm 
was  run  on  a  486,  33  MHz  PC.  Table  5.1  shows  some  of  the  runtime  statistics  of  the  program.  The 
highest  uncertainty  design,  corresponding  to  /?=5  was  obtained  in  approximately  one  hour.  Notice 
that  the  number  of  flops  and  the  run  time  are  essentially  linear  with  respect  to  the  log  of  the  scale 
factor  13.  This  general  trend  has  also  been  observed  in  other  design  examples. 


Table  5.1.  Run-Time  Statistics  of  the  Maximum  Entropy  Homotopy  Algorithm 


Initial 

beta 

Final 

beta 

Megaflops 

RealTime 

(sec.) 

Predictions 
&  Corrections 

0 

.01 

1246.25 

1027.27 

43 

0.1 

.1 

1061.41 

884.80 

36 

.1 

1 

1061.49 

889.84 

36 

1 

5 

1083.25 

995.87 

41 

Figures  5.2  and  5.3  compare  respectively  the  magnitude  and  phase  of  the  initial  LQG  controller 
and  the  Maximum  Entropy  controllers  corresponding  to  (3  =  1  and  /?  =  5.  Notice  that  the  P  =  b 
controller  has  a  very  smooth  frequency  response  and  is  positive  real  over  a  very  large  frequency 
band.  The  smoothness  of  this  controller  indicates  that  its  effective  order  is  much  less  than  17.  Using 
balanced  controller  reduction,  a  4th  order  compensator  was  obtained  that  was  nearly  identical  to 
the  17th  order  compensator. 
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6.  The  Multivariable  Parabola  Criterion  for  Robust  Control  Design  and 
Analysis  [2.13,  2.17] 

One  of  the  most  basic  issues  in  system  theory  is  the  stability  of  feedback  interconnections. 
Four  of  the  most  fundamental  results  concerning  stability  of  feedback  systems  are  the  small  gain, 
positivity,  circle  and  Popov  theorems.  In  a  recent  paper  [6.1],  each  result  was  specialized  to  the 
problem  of  robust  stability  involving  linear  uncertainty,  and  a  Lyapunov  function  framework  was 
established  providing  connections  between  these  classical  results  and  robust  stability  via  state 
space  methods.  As  shown  in  [6.1],  the  main  difference  between  the  small  gain,  positivity,  and 
circle  theorems  versus  the  Popov  theorem  is  that  the  former  results  guarantee  robustness  with 
respect  to  arbitrarily  time-varying  uncertainty  while  the  latter  does  not.  This  is  not  surprising 
since  the  Lyapunov  function  foundation  of  the  small  gain,  positivity,  and  circle  theorems  is  based 
upon  conventional  or  "fixed”  quadratic  Lyapunov  functions  which  guarantee  stability  with  lespect 
to  arbitrarily  time-varying  perturbations.  Since  time-varying  parameter  variations  can  destabilize 
a  system  even  when  the  parameter  variations  are  confined  to  a  region  in  which  constant  variations 
are  nondestabilizing,  a  feedback  controller  designed  for  time-varying  parameter  variations  may 
unnecessarily  sacrifice  performance  when  the  uncertain  real  parameters  are  constant. 

Whereas  the  small  gain,  positivity  and  circle  results  are  based  upon  fixed  quadratic  Lyapunov 
functions,  the  Popov  result  is  based  upon  a  quadratic  Lyapxinov  function  that  is  a  function  of  the 
parametric  uncertainty.  Thus,  in  effect,  the  Popov  result  guarantees  stability  by  means  of  a  family 
of  Lyapunov  functions.  For  robust  stability,  this  situation  corresponds  to  the  construction  of  a 
parameter-dependent  quadratic  Lyapunov  function  [6.2].  A  key  aspect  of  this  approach  is  the  fact 
that  it  does  not  apply  to  arbitrarily  time- varying  uncertainties,  which  renders  it  less  conservative 
than  fixed  quadratic  Lyapunov  functions  (such  as  the  small  gain,  positivity,  and  circle  results)  in 
the  presence  of  constant  real  parameter  uncertainty.  An  immediate  application  of  the  parameter- 
dependent  Lyapunov  function  framework  of  [6.2]  is  the  reinterpretation  and  generalization  of  the 
classical  Popov  criterion  as  a  parameter-dependent  Lyapunov  function  for  constant  linear  paramet¬ 
ric  uncertainty. 

From  a  theoretical  perspective,  an  important  contribution  of  this  research  is  the  unification  of 
the  circle  and  Popov  criteria  via  a  parameter-dependent  Lyapunov  function  framework  that  yields 
both  results  as  special  cases.  The  unification  of  the  circle  and  Popov  criteria  per  se  is  not  new 
to  this  research.  Indeed,  a  parablola  test  which  accomplishes  this  goal  was  originally  developed  in 
[6.3]  and  further  studied  in  [6.4].  However  these  results  are  confined  to  SISO  systems  and  rely  on 
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graphical  techniques.  This  research  thus  accomplished  four  specific  goals: 

1.  It  provided  a  general  framework  for  the  parabola  test  in  terms  of  parameter-dependent  Lya¬ 
punov  functions  in  the  spirit  of  [6.2]; 

2.  It  developed  a  state  space  characterization  of  the  parabola  test  via  Riccati  equations; 

3.  It  developed  a  multivariable  extension  of  the  parabola  test  for  parametric  uncertainty;  and 

4.  It  used  these  results  to  develop  equations  for  robust  controller  synthesis. 

One  of  the  limitations  of  Popov  theory  is  that  it  restricts  the  uncertainty  to  vary  in  only  one 
direction  (that  is,  positive  or  negative).  The  parabola  test,  however,  allows  the  uncertainty  to  vary 
in  both  directions  and  hence  can  potentially  lead  to  analysis  and  design  tools  that  are  more  easily 
applied  than  those  resulting  from  Popov  theory.  Hence,  this  research  could  result  in  robustness 
analysis  tools  that  are  more  useful  to  the  practicing  controls  engineer. 
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7.  Application  of  Popov  Robustness  Tests  to  a  Benchmark  Problem 
[2.4,  2.5,  2.18,  2.19] 

Over  the  past  several  years,  significant  attention  has  been  devoted  to  the  use  of  small  gain(or 
Hoo)  tests  for  robustness  analysis.  However,  it  is  well  known  that  these  tests  can  be  very  conservative 
since  in  the  frequency  domain  the  small  gain  test  characterizes  uncertainty  with  bounded  gain  but 
arbitrary  phase  while  in  the  time  domain  the  small  gain  test  characterizes  uncertainty  with  arbitrary 
time  variation.  This  conservatism  has  led  to  the  search  for  more  accurate  robustness  tests.  In 
particular,  researchers  have  sought  tests  that  allow  frequency  domain  uncertainty  characterization 
to  include  phase  bounding  or  time  domain  uncertainty  characterization  to  include  restrictions  on 
the  allowable  time  variations. 

As  discussed  in  the  previous  section,  the  small  gain,  circle  and  positivity  tests  are  based  upon 
conventional  or  “fixed”  quadratic  Lyapunov  functions  which  guarantee  stability  with  respect  to 
arbitrarily  time- varying  perturbations.  In  contrast,  the  Popov  test,  based  on  a  parameter  dependent 
Lyapunov  function,  restricts  the  allowable  time  variation  of  the  perturbation. 

In  this  research  we  used  a  benchmark  problem  to  compare  the  Popov  test  with  the  small  gain 
and  positivity  tests.  Each  of  the  stability  tests  have  graphical  interpretations  for  the  case  of  one 
block,  scalar  uncertainty.  These  graphical  tests  were  applied.  However,  the  state  space  tests  that  are 
based  on  Riccati  equations  are  emphasized  since  they  extend  to  more  general  forms  of  uncertainty 
and  also  allow  the  development  of  robust  H2  performance  bounds.  Homotopy  algorithms  were 
developed  for  the  special  case  of  one-block,  scalar  uncertainty.  The  algorithm  for  Popov  analysis 
additionally  required  that  a  certain  product  [CaBa)  related  to  the  uncertainty  characterization  equal 
zero.  This  condition  does  hold  for  the  benchmark  problem  under  consideration.  The  robustness 
tests  were  applied  to  analyze  a  feedback  system  for  the  benchmark  system  in  which  the  controller 
was  designed  using  the  Maximum  Entropy  approach. 

The  open-loop  benchmark  system  is  the  two-mass/spring  system  shown  in  Figure  7.1.  The 
stiffness  k  is  uncertain.  A  control  force  acts  on  body  1,  and  the  position  of  body  2  is  measured, 
resulting  in  a  noncolocated  control  problem.  Here,  we  consider  Controller  #1  of  [7.1]  which  was 
designed  for  Problem  #1  of  a  benchmark  problem  [7.2]  using  the  Maximum  Entropy  robust  control 
design  technique.  The  controller  was  designed  so  that  the  closed-loop  system  is  robust  with  respect 
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Figure  7.1.  The  benchmark  system  for  robust  control  design  and  analysis  is  a  two-mass/spring  system 
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to  perturbations  in  the  nominal  value  of  the  stiffness  k  (i.e.,  k  =  knom)-  The  exact  stiffness  stability 
region  over  which  the  system  will  remain  stable  was  computed  by  a  simple  search  and  is  given  by 

0.4458  <k  <  2.0661. 

Next,  using  a  graphical  approach  and  the  state-space  Riccati  equation  approach  (implemented  via 
homotopy  algorithms),  we  apply  small  gain  analysis,  positivity  analysis,  and  Popov  analysis  to 
determine  the  stiffness  stability  regions  predicted  by  each  of  these  tests.  Each  of  these  tests  is 
related  to  the  previous  test  and  is  guaranteed  to  be  less  conservative. 

When  the  homotopy  algorithms  corresponding  to  the  state  space  tests  for  small  gain,  positivity, 
and  Popov  analysis  were  applied  to  the  benchmark  problem,  the  performance  curves  shown  in  Figure 
7.2  resulted.  As  expected,  Popov  analysis  yielded  less  conservative  results  than  the  positivity  and 
small  gain  tests.  The  robust  stability  bounds  Ak  (positive)  and  Ak  (negative)  obtained  from  the 
state  space  tests  were  identical  to  those  obtained  from  the  frequency  domain  tests.  In  fact,  the 
stability  region  predicted  by  the  Popov  test  was  identical  to  the  true  stability  region! 
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cost  bound 


Cost  Bounds  for  Various  Robustness  Tests 


Figure  7.2.  The  performance  bounds  predicted  by  Popov  analysis  were  significantly 
less  conservative  than  those  predicted  by  the  small  gain  and  positivity  tests 
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8.  A  Numerical  Algorithm  for  Optimal  Popov  Controller  Analysis  and  Appli¬ 
cations  to  a  Structural  Testbed  [2.7,  2.21] 

One  of  the  most  important  aspects  of  the  control  design  and  evaluation  process  is  the  analysis  of 
feedback  systems  for  robust  stability  and  performance.  Significant  attention  has  been  devoted  over 
the  past  several  years  to  the  use  of  bounded  gain  and  other  norm-based  methods  for  these  analysis 
tests.  Unfortunately,  due  to  their  dependence  on  norms,  these  tests  exclude  the  phase  information 
on  the  system  uncertainties  and  can  be  very  conservative  for  systems  with  constant  real  parameter 
errors.  A  technique  to  reduce  the  conservatism  inherent  in  fixed  quadratic  Lyapunov  functions  has 
recently  been  introduced  (see,  e.g.,  [2.3,  2.17]).  The  approach  considers  Lyapunov  functions  that 
explicitly  contain  the  uncertain  parameters,  and  thus  restrict  the  allowable  time-variation  of  the 
uncertainties. 

The  purpose  of  this  research  is  to  combine  several  recent  advances  on  Popov  controller  analysis 
and  synthesis.  Refs.  [2.5,  2.19]  have  recently  demonstrated  that  the  state  space  Popov  analysis 
criterion  is  much  less  conservative  than  similar  positive  real  and  small  gain  (/foe)  criteria.  In  this 
research,  we  extend  the  earlier  work  by  considering  systems  with  multiple  uncertainties  that  have 
both  upper  and  lower  sector  bounds.  The  stability  criterion  is  developed  using  a  more  general 
stability  multiplier 

W{s)=^  H  +  Ns,  H>0,  N>0. 

The  algorithm  of  [2.5,  2.19]  was  developed  for  H  =  L  The  new  algorithm  also  considers  the  case 
CqBo  ^  0.  The  simplifying  assumptions  in  [2.5,  2.19]  that  Co^o  =  0  is  only  valid  for  a  very 
restricted  set  of  parameter  uncertainties. 

The  optimal  Popov  analysis  algorithm  is  demonstrated  using  several  robust  control  designs  that 
were  developed  for  the  Middeck  Active  Control  Experiment  (MACE)  (see  Figure  8.1)  located  at 
the  Massachusetts  Institute  of  Technology.  Figure  8.2  shows  the  curves  of  robust  (^2)  performance 
vs.  guaranteed  robust  stability  for  an  LQG  controller,  a  Maximum  Entropy  (ME)  controller  and 
two  multiple  model  (MM)  controllers.  Each  of  the  controllers  had  at  least  one  unstable  eigenvalue 
except  the  “stable  MM.”  Figure  8.3  shows  the  improvement  in  the  stable  MM  design  when  it  was 
refined  using  Popov  controller  synthesis  (PCS). 
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Figure  8.1.  Middeck  Active  Control  Experiment  (MACE)  Test  Article 
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Figure  8.2.  Robust  Stability  and  Performance  Analysis  Using  Several  Controllers  for  MACE 
(Symbols  x  indicate  nominal  H2  performance  for  each  design) 
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Figure  8,3.  Robustness  Improvements  Achieved  by  Popov  Controller  Synthesis 
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9.  Generalized  Fixed-Structure  Optimality  Conditions  for  H2  Optimal  Control 

[2.8,  2.22] 

One  of  the  foundational  results  in  modern  control  theory  is  the  development  of  a  charac¬ 
terization  of  the  globally  optimal  H2  controller  via  algebraic  Riccati  equations.  This  result  has 
traditionally  been  derived  via  the  Calculus  of  Variations  or  the  Maximum  Principle  in  conjunction 
with  the  Separation  Principle.  Unfortunately,  the  optimal  H2  or  LQG  (Linear-Quadratic-Gaussian) 
controller  has  dimension  equal  to  that  of  the  plant  (although  it  may  have  minimal  dimension  which 
is  less  than  that  of  the  plant).  This  has  motivated  the  search  for  optimal  reduced-order  controllers 
(i.e.,  controllers  that  have  dimension  less  than  that  of  the  plant). 

Because  the  Calculus  of  Variations  and  the  Maximum  Principle  characterize  globally  optimal 
solutions,  these  traditional  methods  for  deriving  the  LQG  result  do  not  extend  to  the  development 
of  characterizations  of  optimal  reduced-order  controllers.  Hence,  researchers  have  developed  the 
optimization  methods  that  allow  the  dimension  and  structure  of  the  controller  to  be  constrained 
a  priori.  These  methods  are  usually  based  on  Lagrange  multiplier  theory  and  will  be  called  here 
‘‘fixed-structure  approaches.”  The  “optimal  projection”  characterization  of  the  necessary  conditions 
for  optimal  reduced-order  control  was  derived  using  a  fixed-structure  approach  and  yields  the 
standard  LQG  regulator  and  observer  Riccati  equations  when  the  dimension  of  the  controller  is 
specified  to  be  equal  to  the  dimension  of  the  plant.  However,  the  original  optimal  projection  results 
and  numerous  extensions  were  derived  by  a  priori  assuming  that  the  controller  is  minimal.  This  is 
a  limiting  assumption  since  it  is  known  that  even  an  LQG  controller  is  not  always  minimal. 

This  research  develops  optimality  conditions  that  are  derived  without  assuming  the  minimality 
of  the  compensator.  The  results  are  specialized  to  the  case  in  which  the  com])ensator  is  constrained 
to  have  the  dimension  of  the  plant.  It  is  shown  that  even  when  compensator  minimality  is  not 
assumed,  fixed-structure  theory  is  able  to  derive  the  LQG  Riccati  equations.  It  is  also  shown  that 
there  exist  sets  of  coupled  Riccati  and  Lyapunov  equations  that  are  identical  in  form  to  the  optimal 
projection  equations  for  reduced-order  control  but  actually  characterize  extremals  to  the  full-order 
compensation  problem.  This  leads  to  a  new  interpretation  of  an  optimal  projection  controller.  In 
particular,  an  optimal  projection  controller  is  a  projection,  described  by  a  projection  matrix  //,  of 
a  “central”  extremal  to  the  H2  optimal  full-order  compensation  problem. 

These  latter  results  are  used  to  discuss  suboptimal  projection  methods  that  are  able  to  produce 
minimal  order  realizations  of  nonminimal  LQG  compensators.  For  this  special  case,  the  similarity 
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transformations  relating  the  projection  matrix  i/  used  by  these  suboptimal  methods  to  the  projection 
matrix  //  and  the  optimal  projection  matrix  r  from  the  standard  optimal  projection  theory  are 
explicitly  defined.  If  the  observability  and  controllability  grammians  of  the  nonminimal  LQG 
compensator  satisfy  certain  rank  conditions,  the  three  projection  matrices  are  proved  to  be  identical 
(i.e.,  T  =  n  =  i/). 
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10,  Construction  of  Low  Authority,  Nearly  Non-  Minimal  LQG  Compensators 
for  Reduced-Order  Control  Design  [2.9,  2.23] 

The  development  of  linear-quadratic-guassian  (LQG)  theory  was  a  major  breakthrough  in  mod¬ 
ern  control  theory  since  it  provides  a  systematic  way  to  synthesize  high  performance  controllers 
for  nominal  models  of  complex,  multi-input  multi-output  systems.  However,  as  discussed  above, 
one  of  the  well  known  deficiencies  of  an  LQG  compensator  is  that  its  minimal  dimension  is  usu¬ 
ally  equal  to  the  dimension  of  the  design  plant.  This  has  led  to  the  development  of  techniques  to 
directly  synthesize  optimal,  reduced-order  controllers  and  techniques  to  synthesize  reduced-order 
approximations  of  the  optimal  full-order  compensator  (i.e.,  controller  reduction  methods). 

The  controller  reduction  methods  almost  always  yield  suboptimal  (and  sometimes  destabilizing) 
reduced-order  control  laws  since  an  optimal  reduced-order  controller  is  not  usually  a  direct  function 
of  the  parameters  used  to  compute  or  describe  the  optimal  full-order  controller.  Nevertheless,  these 
methods  are  computationally  inexpensive  and  sometimes  do  yield  high  performing  and  even  nearly 
optimal  control  laws.  An  observation  that  holds  true  about  most  of  these  methods  is  that  they 
tend  to  work  best  at  low  control  authority.  However,  to  date  no  rigorous  explanation  has  been 
presented  to  explain  this  phenomenon. 

One  of  the  purposes  of  this  paper  is  to  provide  a  partial  explanation  as  to  why  the  suboptimal 
projection  methods  tend  to  work  at  low  control  authority.  The  discussion  here  focuses  on  stable 
systems.  It  is  shown  that  if  the  state  weighing  matrix  Ri  or  disturbance  intensity  (or  covariance 
for  discrete  systems)  Vi  has  a  specific  structure  in  a  basis  in  which  the  A  matrix  is  upper  or 
lower  block  triangular,  respectively,  then,  as  illustrated  by  Figure  8.1,  at  low  control  authority 
the  corresponding  LQG  compensator  is  nearly  nonminimal  and  can  hence  be  easily  reduced  to  a 
nearly  optimal  reduced-order  controller.  The  conditions  presented  for  and  Vi  often  are  satisfied 
or  nearly  satisfied  in  practice.  Hence,  for  stable  systems  the  results  proved  in  this  research  do 
offer  one  explanation  of  why  suboptimal  controller  reduction  methods  often  provide  nearly  optimal 
control  laws  at  low  authority.  If  these  conditions  are  not  satisfied,  then,  as  illustrated  by  Figure 
10.2,  at  low  control  authority  the  LQG  compensator  is  not  necessarily  nearly  nonminimal.  The 
basic  results  can  be  used  as  guidelines  for  choosing  Ri  and  Vi  such  that  suboptimal  controller 
reduction  methods  yield  “good”  reduced-order  controllers. 
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Figure  10.1.  Non-minimality  Indicator  of  the  LQG  Controller  (solid  line)  and 
the  Norm  of  the  Cost  Gradient  of  a  2’^‘^-order  Balanced  Controller 
(dashed  line)  for  a  “Good  Structured”  Ri 
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Figure  10.2.  Non-minimality  Indicator  of  the  LQG  Controller  (solid  line)  and  the  Norm  of  the  Cost 
Gradient  of  a  2^^-order  Balanced  Controller  (dashed  line)  for  a  “Bad  Structured”  Bi 
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Suboptimal  controller  reduction  methods  can  be  used  to  initialize  algorithms  for  synthesizing 
reduced-order  controllers.  Of  particular  interest  are  continuation  and  homotopy  algorithms  since 
they  are  based  on  allowing  the  plant  and  weights  defining  an  optimization  problem  to  vary  as  a 
function  of  the  homotopy  parameter  A  6  [0, 1].  These  homotopy  algorithms  rely  on  choosing  the 
initial  plant  and  weights  so  that  the  corresponding  LQG  compensator  is  easily  reduced  to  a  nearly 
optimal  reduced-order  compensator  of  the  desired  dimensions.  Hence,  the  results  developed  in  this 
research  provide  some  rigorous  guidelines  for  initializing  these  algorithms.  Note  that  the  restriction 
to  stable  systems  is  not  necessarily  limiting  since  the  freedom  involved  in  defining  a  continuation 
or  homotopy  map  allows  this  assumption  to  be  satisfied.  However,  future  work  will  focus  on  theory 
that  directly  applies  to  unstable  systems. 
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11.  Continuation  Algorithms  for  H2  Optimal  Reduced-Order  Modeling  and 
Control  Using  the  Optimal  Projection  Equations  [2.10,  2.11,  2.24,  2.25] 

Most  algorithms  to  date  for  H2  optimal  reduced-order  modeling  and  control  are  descent  al¬ 
gorithms,  such  that  at  each  iteration  they  are  guaranteed  to  decrease  the  cost.  An  exception  has 
been  the  continuation  and  homotopy  algorithms  of  [11.1-11.6].  These  algorithms  are  not  descent 
methods  and  since  the  shortest  path  from  a  given  initial  condition  to  an  optimal  solution  is  not 
necessarily  a  descent  path,  these  algorithms  have  the  potential  to  be  more  efficient  than  the  descent 
methods.  In  addition,  when  a  physical  continuation  or  homotopy  path  is  used,  the  reduced-order 
model  or  controller  at  each  point  along  the  homotopy  path  is  guaranteed  to  be  a  meaningful  model 
or  controller  for  the  physical  system.  Under  mild  conditions,  the  homotopy  paths  of  the  algorithms 
developed  in  [11.5,  11.6]  are  guaranteed  to  exist. 

A  common  feature  of  the  continuation  and  homotopy  algorithms  of  [11.4-11.6]  is  that  they  are 
based  directly  on  the  gradient  expressions.  In  these  schemes,  the  parameter  vector  p  represents  the 
reduced-order  model  or  controller.  In  order  to  keep  the  dimensionality  of  p  relatively  small  and 
to  avoid  high  order  singularities  along  the  homotopy  path,  minimal-order  parameterizations  of  the 
reduced-order  model  or  controller  were  considered.  However,  since  the  assumed  parameterization 
may  fail  to  exist  or  lead  to  ill-conditioning  related  to  the  insistence  on  using  the  minimal  number 
of  parameters,  these  resulting  algorithms  sometimes  fail  or  have  very  poor  convergence  properties. 
On  alternative  approach  proposed  in  [11.4-11.6]  is  to  develop  an  algorithm  that  utilizes  several 
minimal  parameter  homotopies  and  is  capable  of  switching  to  an  alternative  parameterization  if  ill- 
conditioning  is  encountered  with  the  current  parameterization.  A  second  approach  is  to  develop 
algorithms  directly  based  on  the  optimal  projection  equations. 

Continuation  and  homotopy  algorithms  based  on  the  optimal  projection  equations  are  given 
in  [11.1-11.3].  However,  the  homotopy  algorithms  of  [11.2,  11.3]  suffer  from  the  curse  of  large 
dimensionality.  The  continuation  algorithm  of  [11.1]  used  a  very  crude  path  following  scheme  in 
which  the  coupled  Riccati  and  Lyapunov  equations  comprising  the  optimal  projection  equations 
for  reduced-order  controller  design  were  not  updated  simultaneously.  This  caused  the  algorithm  to 
exhibit  poor  convergence  properties,  especially  as  the  control  authority  was  increased. 

This  research  uses  the  optimal  projection  equations  to  develop  new  continuation  algorithms  for 
H2  optimal,  reduced-order  modeling  and  control.  These  algorithms  avoid  the  large  dimensionality 
of  [11.2,  11.3]  by  using  the  resiilts  of  [11.7]  to  efficiently  solve  sets  of  linearly  coupled  Lyapunov 
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equations  whose  solutions  describe  either  the  tangent  vectors  or  Newton  corrections.  The  poor 
convergence  properties  of  [11.1]  are  avoided  by  simultaneously  updating  each  of  the  optimal  pro¬ 
jection  equations.  The  new  continuation  algorithm  for  H2  optimal  reduced-order  controller  design 
produced  the  optimal  curves  for  the  benchmark  “four  disk  problem”  which  are  shown  in  Figure 
11.1. 

Note  that  the  design  model  was  8th  order.  . 
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Optimal  Reduced  Order  Controllers  for  the  Four  Disk  Problem 


Figure  11.1.  Comparison  of  the  Performance  Curves  for  Various  Order  Controllers  for  an 

Order  Four- Disk  Plant 
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12.  Analysis  and  Synthesis  with  the  Complex  Structured  Singular  Value  Using 
Fixed  Structure  i^-Scales  [2.12,  2.13,  2.26-2.28] 

A  fundamental  problem  in  control  engineering  is  the  design  of  feedback  controllers  that  are 
insensitive  to  errors  in  the  control  design  model.  The  characterization  of  the  uncertainty  occurs 
somewhere  between  two  extremes,  parametric  and  nonparametric  uncertainty.  Parametric  uncer¬ 
tainty  here  describes  errors  that  can  be  translated  into  errors  in  the  elements  of  some  time-invariant, 
state  space  representation  of  the  design  model.  An  example  of  this  type  of  uncertainty  would  be 
errors  in  the  mass  or  stiffness  parameters  of  a  finite  element  model.  On  the  other  hand,  nonpara¬ 
metric  uncertainty  is  best  viewed  in  the  frequency  domain  and  describes  errors  that  have  bounded 
gain  but  arbitrary  phase.  Of  course,  there  are  types  of  uncertainty  that  do  not  fit  succinctly  into 
either  of  these  two  categories  (e.g.,  state  space  uncertainty  in  which  some  time  variation  is  allowed, 
or  frequency  domain  uncertainty  in  which  the  phase  is  also  bounded).  Hence  in  practice,  there  are 
“shades  of  grey”  when  describing  model  uncertainty. 

This  research  considers  control  design  for  nonparametric  uncertainty.  This  type  of  uncertainty 
can  be  incorporated  into  the  control  design  process  using  the  small  gain  theorem.  This  theorem 
considers  only  one-block  uncertainty.  Unfortunately,  for  many  systems  the  uncertainty  occurs 
simultaneously  in  disparate  parts.  For  example,  in  a  model  of  a  flexible  structure,  the  errors 
might  exist  in  the  sensor  and  actuater  dynamics  in  addition  to  errors  which  exist  due  to  unmodeled 
dynamics.  When  uncertainty  is  present  in  the  system  in  various  places,  control  synthesis  based  solely 
on  the  small  gain  theorem  may  yield  conservative  control  laws  since  the  model  of  the  uncertainty 
will  then  take  into  account  errors  that  are  not  in  the  true  uncertainty  set.  This  conservatism 
motivated  the  development  of  the  structured  singular  value. 

The  standard  method  for  controller  synthesis  based  on  the  structured  singular  value  is  usually 
referred  to  as  ‘‘D  —  K  iteration.”  This  process  begins  by  fixing  the  jD-scales  defining  an  upper  bound 
on  the  structured  singular  value  (usually  to  D  =  I)  and  designing  an  Hoo  optimal  controller  K. 
Then  with  K  fixed  the  D-scale  magnitudes  are  optimized  over  (theoretically)  all  frequencies.  Some 
optimal  curve  fit  is  then  needed  to  find  rational  transfer  functions  that  approximate  the  optimal 
D-scale  magnitude  plots  (vs.  frequency).  Then,  with  the  X)-scales  fixed  to  their  rational  transfer 
function  approximations  another  Hoo  controller  K  is  designed.  The  i)-scales  are  then  reoptimized 
(with  K  fixed).  This  process  continues  until  convergence  or  until  an  acceptable  controller  is  found. 

Standard  D  -  K  iteration  with  curve  fitting  has  the  advantage  that  a,t  each  iteration,  a  convex 
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optimization  problem  is  solved,  although  the  overall  design  process  is  not  convex.  However,  this 
process  also  has  serious  drawbacks.  First,  there  may  not  be  a  rational  transfer  function  that 
corresponds  to  the  optimal  D-scale  magnitude  plot  (vs.  frequency).  Even  if  such  a  function  exists, 
it  may  be  of  very  high  order.  If  a  low  order  transfer  function  is  used,  the  design  process  will  lead  to 
a  suboptimal  controller.  In  fact,  the  resulting  controller  will  generally  not  be  the  optimal  controller 
for  the  D-scale  of  the  given  order. 

This  research  develops  a  method  for  structured  singular  value  controller  synthesis  that  does 
not  require  curve  fitting.  In  particular,  the  designer  is  allowed  to  a  priori  constrain  the  D-scales 
to  be  constant.  The  approach  here  is  based  on  recent  results  in  mixed  norm  H2IH00  theory.  As 
illustrated  by  Figure  12.1,  for  D-scales  of  a  given  order,  the  resultant  controllers  can  have  better 
robustness  properties  than  those  obtained  using  standard  D  —  K  iteration  and  curve  fitting. 
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upperbound  on  SSV 


Figure  12.1.  Upper  Bounds  on  the  CSSV  Using  the  (Optimal) 
Fixed  Structure  Approach  and  Standard  D-K  Iteration 
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Appendix  A: 

Maximum  Entropy- Type  Lyapunov  Functions 
for  Robust  Stability  and  Performance  Analysis 
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Abstract:  We  present  two  Lyapunov  functions  that  ensure  the  unconditional  stability  and  robust  performance  of  a  modal  system  with 
uncertain  damped  natural  frequency.  Each  Lyapunov  function  involves  the  sum  of  two  matrices,  the  first  being  the  solution  to  the 
so-called  maximum-entropy  equation  and  the  second  being  a  constant  auxiliary  portion.  The  significant  feature  of  these  Lyapunov 
functions  is  that  the  guaranteed  robust  stability  region  is  independent  of  the  weighting  matrix,  while  the  performance  bounds  are 
relatively  tight  compared  to  alternative  approaches.  Thus,  these  Lyapunov  functions  are  less  conservative  than  standard  bounds  that 
tend  to  be  highly  sensitive  to  the  choice  of  state  space  basis. 

Keywords:  Maximum-entropy  function;  robust  stability;  robust  performance 


1.  Introduction 

The  maximum-entropy  approach  to  robust  control  was  specifically  developed  to  address  the  problem  of 
modal  uncertainty  in  flexible  structures  [2,5,6,18,19].  The  rationale  for  this  approach  was  based  upon 
insights  from  the  statistical  analysis  of  lightly  damped  structures  [20],  Despite  favorable  comparisons  to 
other  approaches  [9, 10, 12, 13]  and  experimental  application  [1 1],  the  basis  and  meaning  of  the  approach 
remain  mostly  empirical  and  largely  obscure.  The  purpose  of  this  paper  is  to  make  significant  progress  in 
developing  a  rigorous  foundation  for  this  approach. 

Besides  the  statistical  modal  analysis  techniques  of  [20],  a  variety  of  formulations  have  been  put  forth  for 
justifying  the  maximum-entropy  approach.  To  reproduce  certain  covariance  phenomena  of  uncertain 
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multimodal  systems  (decorrelation,  incoherence,  and  equipartition;  see  [20]),  a  multiplicative  white-noise 
model  was  invoked  [18, 19].  The  specific  model  chosen  was  interpreted  in  the  sense  of  Stratonovich,  thus 
entailing  a  critical  correction  term  in  the  covariance  equation  due  to  the  conversion  from  Stratonovich  to  Ito 
calculus.  The  Stratonovich  model  was  itself  based  upon  a  limiting  process  in  which  the  parameter  entropy 
increased,  thus  suggesting  the  name  “maximum-entropy”  control.  White-noise  models  as  a  basis  for  robust 
control  are  discussed  in  [1]. 

An  alternative  justification  for  the  maximum-entropy  model  was  given  in  [14]  in  terms  of  positive  real 
transfer  functions.  This  attempt  was  motivated  by  the  observation  that  in  the  limit  of  high  modal  frequency 
uncertainty  the  maximum-entropy  controller  assumed  a  rate  dissipative  structure  [18, 19].  An  alternative 
attempt  to  justify  the  maximum-entropy  model  was  given  in  [17],  where  a  covariance  averaging  approach 
[16]  was  used  to  show  that  if  the  state  covariance  is  averaged  over  uncertain  modal  frequencies  possessing 
a  Cauchy  distribution,  then  the  resulting  averaged  covariance  satisfies  the  maximum-entropy  covariance 
model. 

Although  the  various  formulations  of  maximum-entropy  theory  lend  considerable  insight  into  the  nature 
of  the  approach,  there  remains  a  significant  gap  between  this  approach  and  more  conventional  techniques, 
such  as  theory.  The  missing  link,  in  our  opinion,  is  the  lack  of  a  Lyapunov  function  that  guarantees  the 
robust  stability  of  the  closed-loop  control  system.  In  this  regard  it  was  long  suspected  that  such  a  Lyapunov 
function  would  be  unconventional,  that  is,  unlike  those  arising  in  theory.  This  view  arose  from  the  fact 
that  the  maximum-entropy  controllers  were  often  robust  to  large  perturbations  in  the  damped  natural 
frequencies,  that  is,  the  imaginary  part  of  the  eigenvalues.  Such  perturbations  are  highly  structured,  and  thus 
are  often  treated  conservatively  by  conventional  small-gain-type  bounds. 

The  goal  of  the  present  paper  is  to  provide  a  Lyapunov  function  basis  for  the  maximum-entropy 
covariance  model  for  the  case  of  modal  frequency  uncertainty.  In  fact,  in  this  special  case,  we  provide  two 
alternative  Lyapunov  functions  along  with  the  corresponding  performance  bounds.  Each  Lyapunov  function 
involves  the  sum  of  two  matrices,  the  first  being  the  solution  to  the  maximum-entropy  equation  (see  equation 
(22))  and  the  second  being  a  constant  auxiliary  portion.  This  construction  is  similar  to  the  parameter- 
dependent  Lyapunov  function  technique  developed  in  [15]  except  that  in  the  present  paper  the  auxiliary 
portion  is  constant,  that  is,  independent  of  the  uncertainty. 

The  maximum-entropy  equation  (22)  differs  fundamentally  from  alternative  robustness  tests  such  as  those 
given  in  [3,4].  Specifically,  whereas  the  modified  Lyapunov  functions  in  [3]  involve  additional  nonnegative- 
definite  terms  in  the  Lyapunov  equation,  the  maximum-entropy  equation  entails  an  indefinite  modification. 
This  distinction  appears  to  play  a  critical  role  with  respect  to  the  way  in  which  the  maximum-entropy 
equation  deals  with  the  change  in  basis  induced  by  the  input  and  weighting  matrices. 

While  this  paper  potentially  provides  a  Lyapunov  function  foundation  for  the  maximum-entropy  control 
approach,  our  results  are  limited  to  open-loop  analysis.  Future  research  will  focus  on  robust  stability  of  the 
closed-loop  system  for  the  controllers  given  in  [2,5,6.9-13, 18-20].  Furthermore,  although  the  techniques 
used  to  construct  the  Lyapunov  functions  for  the  maximum-entropy  equation  are  limited  to  modal  frequency 
uncertainty,  they  appear  to  be  generalizable  to  larger  classes  of  uncertainty.  Nevertheless,  for  structures  with 
modal  frequency  uncertainty  [2,  5,  6,  9-13,  18,  19],  these  results  have  practical  ramifications. 


2.  Robust  stability  and  performance  problems 

Let  -P/  c  R"*"  denote  a  set  of  perturbations  AA  ofa  given  nominal  dynamics  matrix  /leR"’'".  It  is  assumed 
that  A  is  asymptotically  stable  and  that  Og-?/. 

Robust  stability  problem.  Determine  whether  the  linear  system 

.v(f)  =  (A  4-^^).v(f),  te[0,oc),  (1) 

is  asymptotically  stable  for  all  AAe^. 
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Robust  performance  problem.  For  the  disturbed  linear  system 

x(r)  =  {A  AA)x(t)  +  Dw{t),  r€[0,  oo),  (2) 

z{t)  =  Ex(t),  (3) 

where  u’(  )  is  a  zero-mean  d-dimensional  white-noise  signal  with  intensity  Ij,  determine  a  performance  bound 
p  satisfying 

^(^)=  sup  limsup£{||z(r)||2}  <  ^-  (4) 

AAei/ 


For  convenience,  define  the  nx«  nonnegative-definite  matrices  E  and  V^DD^.  The  following 

result  is  immediate.  For  a  proof,  see  [3]. 

Lemma  2.1.  Suppose  A  +  AA  is  asymptotically  stable  for  all  AAe-i^.  Then 

3rtfU)  =  sup  R)  =  sup  tr(Pj.4  V),  (5) 

JAe»  JAei/ 

where  Qj^elR"*"  and  are  the  unique,  nonnegative-definite  solutions  to 

0  =  (/I  -I-  AA)Qj,,  -1-  QjAA  +  AAA  +  V  (6) 

and 

0  =  (A-y  AAfPj,,-t- PjAA  + AA)-y  R.  .  (7) 

Conditions  for  robust  stability  and  robust  performance  are  developed  in  the  following  theorem.  Let  J  "” 


and  Sf”"  denote  the  sets  of  n  x  n  nonnegative-definite  and  symmetric  matrices,  respectively. 

Theorem  2.2.  Let  Qq'.J''’'  -*y',  and  suppose  there  exists  P6..C"  satisfying 

0  =  A'^P  PA  -y  QoiP)  +  R.  (8) 

Furthermore,  let  Pq  .^  -y  Sf”'  and  R^eS/”'  be  such  that  Rq  <  R, 

AA'^P -y  PAA  <QiP,AA) -y  Ro,  AAe^ ,  (9) 

and 

P-yPo(AA)>0,  AAe^,  (10) 

where 

Q(P,AA)  ^  Qo(P)  -  [(-4  +  AAfiPoiAA)  +  Po{AA){A  -y  AA)].  (11) 

Then 

{R  —  Rq,  A  -y  A  A),  A  As^/,  (12) 

is  detectable  if  and  only  if 

A-yAA,  AAe^?/,  (13) 

is  asymptotically  stable.  In  this  case,  the  following  statements  are  true.  If  y  <  \  is  such  that  Rq  <  yR.  then 

PjA<-r^{P  +  PoiAA)),  AA€%,  (14) 

1  —  y 

where  Pj^  satisfies  (7),  and 

srm<-^ltT{PV)-y  suptr(Po(d^)F)].  (15) 
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In  addition,  if  there  exists  that 

Po{AA)<Po,  (16) 

then 

+  Po)yi-  (17) 

1  -y 


Proof.  Note  that,  for  all  (8)  is  equivalent  to 

0  =  (/I  +  AAYiP  +  PoiAA))  +  (P  +  Po{AA)){A  +  AA)  +  QoiP)  +  P 
-  [(/I  +  AA)^Po{AA)  +  Po{AA)(A  +  AA)]  -  (AA'^ P  +  PAA) 

,={A  +  AA)'^{P  +  Po(^>l))  +  iP  +  Po(^A))(A  +  AA)  +  R  -  Ro  +  R'o,  (18) 


where 

R'o  ^  QoiP)  +  Ro-  [(^  +  AA)^Po(AA)  +  Po{AA)(A  +  A  A)]  -  (AA'^  P  +  PAA) 

=  Q(P,AA)  +  Ro-  {AA'^P  +  PAA). 

Hence,  (18)  has  a  solution  PeA'^"  for  all  AAs^.  Thus,  if  the  detectability  condition  (12)  holds  for  all  AAe^ll, 
then  it  follows  from  [21, Theorem  3.6]  that  {R  —  Rq  +  +  AA)  is  detectable,  AA&^.  It  now  follows  from 

(18)  and  [21,  Lemma  12.2]  that  A  +  AA  is  asymptotically  stable,  AAe‘^.  Conversely,  A  +  AA  is  asymp¬ 
totically  stable  for  all  then  (12)  is  immediate. 

Now,  subtracting  (1  —  v)-(7)  from  (18)  yields 

0  =  (/I  -h  AA)'^{P  +  PoiAA)  -  (1  -  y)Pj,)  +  (P  +  PoiAA)  -  (1  -  y)P,,){A  +  AA) 

+  Ro-Ro  +  yR,  AAe%,  (19) 

or,  since  A  +  AA  is  asymptotically  stable  for  all  AAe^  and  Rq  <  yR,  (19)  implies  that,  for  all  AA^%, 

P  -h  PoiAA)  -  (1  -  y)Pj^  =  f  +  yR  -  /?o]e'^+^^''dt 

Jo 

Jo 

>0, 


which  implies  (14). 

Next,  using  (14),  it  follows  from  (5)  that 


(-?/)  =  sup  trlD^Pj.^D)  <  — sup  tr[Z)^(P  -f  PoiAA)) D] 

JA€l/  ^  ~  y 


1 


1-7 


tT{PV)+  sup  tr  (Po(^^)l^) 


AAeif 


]■ 


which  yields  (15).  Furthermore,  using  (16)  it  follows  that 


J'(^)  < 


-  tr(PF)-t- suptr(Po(d^)F)  ^  ^^[tr  (PF) -h  tr(Po  F)] 

7L  AAeif  J  1-7 


1-7 


tr[(P  +  Po)F], 


□ 
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Remark  2.3.  Theorem  2.2  is  a  generalization  of  Theorem  3.1  of  [15].  Specifically,  the  bound  in  [15]  is 
required  to  hold  for  all  nonnegative-definite  matrices,  w^hereas  in  Theorem  2.2  equation  (9)  need  only  hold  for 
the  solution  P  of  (8).  Furthermore,  in  [15],  Rq  =  0. 

Remark  2.4.  Inequality  (9)  is  equivalent  to 

(A  -1-  AAf{P  +  Po(AA))  +  {P  +  Po(AA))iA  +  AA)  +  R  -  Ro<0, 

which  shows  that  V{x)  =  x^{P  -t-  is  a  Lyapunov  function  corresponding  io  A  +  AA.lxi  construct¬ 

ing  this  Lyapunov  function,  the  matrix  P  can  be  viewed  as  a  predictor  term,  Po(d^)  provides  a  corrector  term, 
and  Pj  ^  P  +  Po(AA)  is  the  total  Lyapunov  matrix. 

Remark  2.5.  IfPo(d^)  is  independent  of  d/1,  then  by  choosing  Pq  =  Po(d/l)  it  follows  that  (15)  is  identical  to 
(17). 


3.  Application  to  the  maximum-entropy  covariance  model 


Now  we  specialize  to  the  case  in  which  is  given  by 


% 


dA  =  £  cr.di.  Iff, I  <di,  i  =  1, 

i=  1 


(20) 


where  Si  >  0  and  the  matrices  djelR"’'",  which  represent  the  uncertainty  structure,  are  the  given  skew- 
symmetric  matrices,  that  is,  Ai  +  Aj  =  0,  i  =  I, . .  .  ,  r.  In  addition,  we  assume  that  A  +  A^  <0.  This 
formulation  can  be  viewed  as  the  representation  of  a  dissipative  system  (such  as  a  flexible  structure)  with 
energy-conserving  perturbations.  This  property  can  be  seen  by  means  of  the  Lyapunov  function  V{x)  =  x^x 
whose  decay  rate  is  independent  of  ff;.  Thus,  A  +  AA  is  uniformly  asymptotically  stable  even  for  arbitrarily 
time-varying  ffi(r).  For  simplicity,  however,  we  confine  our  analysis  to  constant  parameter  uncertainty.  In 
addition,  although  the  system  is  robustly  stable  for  time-varying  parameter  uncertainties,  the  performance 
bounds  we  obtain  via  Theorem  2.2  are  valid  only  for  the  case  of  constant  parameter  uncertainty. 

We  now  introduce  a  specific  choice  of  QoiP)  that  is  motivated  by  the  maximum-entropy  covariance  model. 
Specifically,  as  in  [18]  we  choose 


QoiP)  =  z  SfiUrP  +  AjPAi  +  ^PAf).  (21) 

i=  1 

First  we  prove  that  with  this  choice  of  QoiP)  equation  (8)  has  a  unique  solution.  Then  we  show  that,  when 
r  =  1,  equation  (8)  has  an  asymptotic  solution  for  <5i  -♦oo. 


Proposition  3.1.  Assume  that  A  +  A^  <  0,  d,-  +  Aj  =  0,  and  >  0,  i  =  1, . .  . ,  r.  Then  there  exists  a  unique 
matrix  Pg1R"’‘"  satisfying 

0  =  d'^P  +  Pd  +  X  +  AjPAi  -I-  iPdf)  +  R.  (22) 

i=  1 

Furthermore,  P  is  nonnegative-definite. 


Proof.  Applying  the  “vec”  operator  [7]  to  (22)  yields 

0  =  vec  P  -f  vec  R ,  (23) 

where 

.a^4(d©d)+  t  ^SHAi@Ay 

i=l 
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and  ©  and  later  0  denote  Kronecker  sum  and  product,  respectively.  Since  /I  +  <  0,  it  follows  that 

(^@^)  +  ^  ^  Q  jjj  addition,  the  assumption  that  At  is  skew-symmetric 

implies  that  /I,©/!,  is  also  skew-symmetric  and  thus  (Ai@Afr  <  0,  i  =  1, .  .  . ,  r.  Thus,  .o/  -f  <  0,  which 
implies  that  sJ  is  asymptotically  stable.  Thus,  (23)  yields  P  =  vec"M  -  •^('“^vec  R).  This  proves  existence 
and  uniqueness. 

Next,  we  show  that  P  is  nonnegative-definite.  Note  that  since  -  =  J*  e'^^'  df,  we  can  write 


P  =  vec“  ‘  (  e vec  R  dr  1 . 


(24) 


After  some  manipulation  (24)  can  be  written  as 


P  =  vec 


“  1 


expl  t 


■  X(i  +  i5.^4?y©  t  +  +  t  U.^(/l,0.4,)T  IvecRdr 


(25) 


Now,  using  the  exponential  product  formula  it  follows  that 


vec 


- 1 


lim 

0  m-*  X 


X  ^  exp  (Al  0  ) J  vec  R  dt^ . 


(26) 


For  simplicity,  we  assume  r  =  1.  If  r  >  1  only  minor  modifications  are  needed.  First  fix  m  and  let  R,o)  —  R; 
define  the  series  Z(j),  R,j),  y  =  0,  1, . . . ,  m  —  1,  by 


vec 1,  (f)  ^  vec  R„-, (t)  =  vec 

\ec  R^j+l^(t)  ^  e\p(^^(^A  +y^i^  ^  vecZ,j+i,(r) 


(t)>l‘i. 


m 


3] 


=  vec  exp  -  A +  — At  ]  Z,j+i,(r)exp  -lA-h—Ai 


m 


3" 


It  is  obvious  that  both  and  R^J){t)  are  nonnegative-definite  matrices  for  all  7  =  0,  —  1  and 

f  >  0.  Finally,  since  m  is  arbitrary,  it  can  be  shown  that 


P  =  vec  ^  I 


Glim  vecR,„,dr )  =  f 

0  m-“«  /  Jo 


lim  R(„,  dr  >  0. 


□ 


Next  we  show  that  (22)  with  r  =  1  has  an  asymptotic  solution  for  -♦  cc.  First,  we  need  the  following 
definition  and  lemma. 


Definition  3.2.  For  f  e  K"  ,  the  smallest  nonnegative  integer  k  such  that  rank  (f  * )  =  rank  (f  *  "^  ‘ )  is  called  the 
index  of  F  and  is  denoted  by  Ind  (F)  [8]. 

Remark  3.3.  If  F  is  invertible,  Ind  (F)  =  0.  Also  Ind(O)  =  1.  We  adopt  the  convention  that  0°  =  1  [8]. 


Definition  3.4.  A  matrix  FelR"""  is  called  EP  [8]  if  either  F  is  invertible  or  there  exists  an  orthogonal  matrix 
l/eIR"’'"  and  an  invertible  matrix  f  iSlR"”''",  where  m  <n,  such  that 


F  = 


0 

0 


t/T. 
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Remark  3.5.  If  F  is  EP,  then  Ind  (f )  <  1,  and  the  group  inverse  F*  of  f  is  given  by  [8] 


Lemma  3.6.  Let  A,  BeU”’”',  where  A  +  <0  and  B  is  an  EP  matrix.  Then 

IndMB)  =  Ind(B).  (27) 


Proof.  Since  B  is  an  EP  matrix,  Remark  3.5  implies  that  Ind  (5)  <  1.  Hence,  we  consider  two  cases. 

(1)  Suppose  Ind  (B)  =  0,  so  that  B  is  invertible.  Since  y4  +  <  0,  it  follows  that  A  is  asymptotically  stable 

and  hence  invertible.  Therefore,  AB  is  invertible  and  thus  Ind  (AB)  =  0. 

(2)  Suppose  Ind(J5)  =  1,  and  let  rank  (B)  =  n  —  r,  where  r  >  1.  Since  B  is  an  EP  matrix,  there  exists  an 
orthogonal  matrix  U  and  a  matrix  Dg  such  that  B  =  UDbU^,  where 


Ds  = 


Bi  0 
0  0 


det (Bi)  #  0. 


Since  rank  (AB)  =  n  —  r,  it  suffices  to  show  that  the  zero  eigenvalue  of  AB  has  multiplicity  r. 
By  writing  U^AU  in  the  form 


A'  ^  U^AU  = 


A'n 

A'2i 


12 

f  » 

22^ 


where  /I'neR"'"'”' /lizeR""',  /I'lzeR'" /I'lieR'”' we  have 


U'^AUDb  = 


A'liBi 

A'2iBi 


0 

0 


Consequently,  the  characteristic  polynomial  of  AB  is 

det  (/./  -  AB)  =  det  (kl  -  UiV^  AU  Dg)  l/^)  =  det  {/.I  -  AU  Dg) 


=  det 


/4'nBi 
—  A2i  Bi 


k'dcti;j„.r-A'nB,). 


(28) 


Equation  (28)  implies  that  the  zero  eigenvalue  of  AB  has  at  least  multiplicity  r. 

The  final  step  is  to  show  that  A'nB^  has  no  zero  eigenvalue  or,  equivalently,  det(/4iiBi)  0.  Since 
/I  +  <  0,  it  follows  that  U^{A  +  A^)  U  <0,  that  is.  A’  +  A'^  <  0.  Thus,  A\ i  +  {A\ ,  )^  <  0,  which  implies 

that  /I'll  is  asymptotically  stable.  Therefore,  we  have  detf/l'u)  #  0.  Noting 


det  (/t 'i  1  Bi )  =  det  (A\ i )  det  (Bi )  #  0 


completes  the  proof.  □ 


For  convenience,  we  define 

/I  ^(/lT©/l^)-'(/lI@/lI)^  (29) 


Lemma  3.7.  Let  /I,  /lieR'"'",  where  .4  +  .4^^  <  0  and  Ai  +  /ij  =  0.  Then  Ind  (A)  =  1. 

Proof.  Since  A^  is  skew-symmetric,  it  follows  that  Ai@Ai  is  also  skew-symmetric.  Thus,  {Ai@Ai)^  is 
symmetric  (actually,  it  is  negative-semidefinite)  and  hence  is  EP.  In  addition,  it  is  obvious  that  Ai@Ai  is 
singular.  Thus,  Ind  (/lj©/l|)^  =  1.  Furthermore,  since  A  +  A^  <0  implies  {A@A)  +  (/l^@/4^)  <  0  and 
equivalently  implies  (/1@/1)“^  -I-  (,4^©/l’^)"'  <  0,  it  follows  from  Lemma  3.6  that  Ind  (A)  =1.  □ 
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We  are  now  ready  to  prove  the  existence  of  an  asymptotic  solution  of  equation  (8)  when  r  =  1.  For 
notational  convenience,  we  replace  Si/2  by  x 


Proposition  3.8.  Let  A,  Re.V'and  2  >  0.  Furthermore,  assume  that  A  +  A^  <Q,Ax  +  =  0,  and 

let  be  the  unique,  nonnegative-definite  solution  to 

0  =  +  P4  +  a(>lf  P  +  2A]PA^  +  P4?)  +  R.  (30) 

Then  P»  ^  lim^^*  P,  exists  and  is  given  by 

Px  =  vec-^[(;-/l/l^)(/l'^@/l^)"*(-vecP)].  (31) 

Proof.  Applying  the  vec  operator  to  equation  (30)  yields 
0  =  [(/1^©/1^)  +  a(/lj@/4|)^]vec  P  +  vecP, 
so  that 

vecP  =  [/  +  a^]"‘ (/l’^©/!^)"^  (—  vecP), 
and  we  can  write  P^  as 


vecPx 


t 


lim  (/  +  aA)-^  (A'^©/!'^)"  ^  ( -  vec  R) 


lim 

2-*  X 


-  1 


(A^@A^)  ‘(— vecP) 


=  lim  z(zl  +  /l)-'(/l'^©/4'^)''(- vecP). 


Now  since  Ind  {A)  =  1,  it  follows  from  [8,  Theorem  7.6.2]  that  the  above  limit  exists  and  is  given  by 
vecPx  =  (/  —  AA*)(A'^@A^)~^  vecP),  which  yields  (31).  □ 


For  the  following  result,  define  the  commutator  [F,  G]  ^  FG  —  GF. 


Lemma  3.9.  Let  A,  /4ielR"’'",  ReJ^’'.  Furthermore,  suppose  that  A  +  A^  <  0,  Ai  +  A]  =  0,  and  let  Pxe.-!"" 
be  given  by  (31).  Then  P*  satisfies 

[/lT,Px]=0.  (32) 


Proof.  Since  A^  is  skew-symmetric,  we  have 

vec  [A],  Px  ]  =  vec  (A]P^  +  P^A,)  =  (A] @  A])vcc  P^ 

=  (A'\®A'l){I  -  AA*){A^@A'^)-'(-  vec R) ,  (33) 


where  A  is  defined  by  (29).  Since,  by  Lemma  3.7,  Ind  (A)  =  1,  it  follows  from  Remark  3.5  that  A  and  A*  can  be 
expressed  in  the  form 


A^V 


C  ( 

’V-, 

,  C"‘  0 

0  ( 

A*  =  V 

)J 

_  0  0_ 

/- 1 


where  det(C)  #  0.  Writing  V  =  [Fj  F2],  the  identity 


ylF  = 


V 


C  0 
0  0 
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implies  that  AV2  =  0.  Consequently,  [A]®  A])^  V2  =  0,  and,  since  Ind (/1 10/41)  =  1,  it  follows  that 
(/lj@  /4j)  V2  =  0.  Therefore,  equation  (33)  can  be  written  as 

^eclA\,P^-i  =  {A]@A])(^I ^jK-‘^(>lT@>lT)-i(-vecR) 

=  (>li@^T)^f'|^Q  vecf?) 

=  (/4T@/4{)[0  Kj]  I^-’(/4^@/4^)-‘(- vec/?) 

=  [0(/4l@/4l)  Kj]  V-^{A'^@A'^)-^(-  vecf?)  =  0. 

As  a  result,  [/4  j,  =  0.  □ 

Remark  3.10.  If  P  is  symmetric.  A^  is  skew-symmetric,  then  it  can  be  shown  that  [/4j,  [/4j,  Px]]  =  0  if  and 
only  if  [Aj,  Px]  =  0-  This  fact  is  of  interest  since  (21)  can  be  written  as 

f2o(F)=  I  WlAj.lAj^P}-]. 

i=  1 

Thus,  if  r=l  and  5i-*-oo,  then  [A  j,  [Al,  ?„]]-►  0.  Note  {di/2)  [/4j,  [Aj,  ?„]]=- (/4'''P3o  + 
P^A  +  R)=  -  vec-  ‘  [(AT 0  A]f  [(A"^ 0  A"^)'  ‘ {A] 0  Aj)^] (A"^ 0  /l"^)- ‘  vec  R]. 


4.  The  choice  of  corrector  term  Pq 

Now  we  propose  a  corrector  term  Pq  for  the  case  of  general  skew-symmetric  matrices  /1/6 IR"  i  =  1 , . . . ,  r, 

where  r  >  1.  For  a  symmetric  matrix  B,  define  |B|  — 

Proposition  4.1.  Assume  A  +  A'^  <  0,  Ai  +  Aj  =  0,  and  5,  >  0,  i  =  1, . . . ,  r.  Let  PejV"  satisfy  (22)  and  let 

^  >  max  I X  -  /min  (P)  j ,  (34) 

where,  for  i  =  1, . . . ,  r, 

Mi  ^  A„3x((^.|[Af,P]|  -i5?[AT,[/lT,P]])(-  A  -  4^)-*). 

IfPo(AA)  ^  pi„,  then  (9)  and  (10)  are  satisfied  with  Ro  =  0  and  ^  given  by  (20). 

Proof.  By  substituting  Po(AA)  =  pi„  into  (9)  with  Ro  =  0  and  letting  G  =  y/-  A'^  -  A,  we  have 
f2(P,  AA)  +  Ro  -  {AA^  P  +  PA  A) 

=  li(-A'^-A)-t  <^iLAj,Pl  +  t  {SnAj,  [AT,P]] 

t=l  i=l 

>)?(- A^-A)-  X  <5.l[/lLP]l+  Zi^f[/IT,[AT,P]] 

i=l  i=i 

=  G{R-  X  G-‘(5.|[AT,P]|-H?[AT,[/1T,/>]])G-i}G 

i  =  1 

>G{)?/„-  X  ^■m.AG-HSi\lAj,Py-{dfiAj,lAj,P:i:\)G-^)I„}G 
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=  G{PIn  -  I  -  1(5?  lAj,  IAJ,P}2)(  -A-  /!^)-*)/„}G 

i=  1 

=  G  {/?/„-  t 

i  =  1 

>  0, 

which  proves  (9).  Finally,  it  is  obvious  that  P  +  PoiAA)  =  P  +  lil„>  /„!„(?)/„  +  /?/„  >  0,  so  that  (10)  is 
satisfied.  □ 


Henceforth,  we  confine  our  attention  to  the  special  case  r  =  1  and 

"■'M  A  ^ 

-1  0 


A  = 


-  n 

—  CO 


(35) 


where  »/  >  0  and  coelR.  For  notational  convenience,  we  adopt  the  traditional  symbol  J  for  A^.  In  this  case 
Qo(P)  given  by  (21)  has  the  form 

Q^{P)  =  S:  (i  P^P  +  J'^PJ  +  iPJ- ) .  (36) 

Note  that  =  —  J  and  where  1 2  denotes  the  2  x  2  identity  matrix. 


Proposition  4.2.  Assume  that  R  is  positive-definite  and  let  P  satisfy  , 

0  =  +  P4  +  dl  iU^'^P  +  rPJ  +  iPJ^)  +  R,  (37) 

let  7  <  1,  and  define 

PoiAA)  A  (1  -  7)  J^PJ  -  yP,  AAe^^.  (38) 

Then  (9)  and  (10)  are  satisfied  with  Rq  =  yR.  Furthermore,  the  performance  bound  (15)  is  given  by 

3r(^)<tTiV)tviP).  (39) 


Proof.  Clearly,  (10)  is  satisfied.  Secondly,  since 

AJ  =  JA,  JJ^  =  rj  =  l2,  J^QoiP)J  =  -QoiP), 
and  P  satisfies  (37),  it  follows  that 

^2o(P)  +  Ro-  liA  +  a^JfPo  +  PoiA  +  ffi  J)]  -  P  +  PJ) 

=  QoiP)  +  Ro-  [(1  -  'AiA'^J'^PJ  +  J'^PJA)  +  ffi(l  -  7)(JV^PJ  +  jTpjJ) 
-  yiA'^P  +  PA)  -  a,y(r  P  +  PJ)]  -  a.iJ'^  P  +  PJ) 

=  QoiP)  +  Po  -  (1  -  ■fiJ'^iA'^P  +  PA)J  +  yiA^  P  +  PA) 

=  QoiP)  +  Po  -  (1  -  -  OoiP)  -  P)  J  +  7(  -  OoiP)  -  R) 

^  Ro-yR-til  -y)J'^RJ 
>0. 

Finally,  we  have 

[tr  iP  n  +  tr  (Po  V)2  =  tr  (P  V)  +  tr  ( J^PJ  V) 

1  -  7 

=  tr[P(F  + JFJT)]  =  tr(F)tr(P).  □ 
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Remark  4.3.  Note  that  unlike  the  parameter-dependent  Lyapunov  function  used  in  [15]  for  the  Popov 
criterion,  the  auxiliary  portion  Po(AA)  given  by  (38)  is  independent  of  ctj.  Therefore,  this  auxiliary  portion 
Po(d.-l)  guarantees  robust  stability  with  respect  to  time-varying  This  robust  stability  property  was 
already  shown  at  the  beginning  of  this  section  by  means  of  the  Lyapunov  function  P(x)  =  x^x. 

Remark  4.4.  Since  by  Proposition  3.1,  equation  (37)  has  a  solution  for  all  >  0,  it  follows  that  robust 
stability  is  guaranteed  for  arbitrary  Oi,  that  is,  not  necessarily  bounded  by  <5i. 

Remark  4.5.  It  is  easy  to  show  that  tr(P)  =  (l/2f;)tr(R)  and  Pj  =  P  +  Pq  =  {I  —  y){J'^PJ  +  P) 
=  ( 1  -  v)  tr  (P)  1 2  ■  Thus,  (39)  becomes 

•^(V/)<  J-tr(L)tr(P).  (40) 

2ri 

Thus,  the  performance  bound  (39)  is  independent  of  di.  Furthermore,  it  is  easy  to  check  that  Pj  satisfies  the 
equation 

0  =  A'^Pt  -t-  PtA  +  J'^RJ  +  R.  (41) 

We  now  present  an  alternative  choice  of  Po{AA). 


Proposition  4.6.  Let 


~PII 

Pl2~ 

R12' 

>0 

P22f 

LRi2 

R22_ 

satisfy  {21)  and  let  Po{A A)  —  nl 2,  where 

H  ^  -  v/(P22  -  Pi i)^  +  (2Pi2)^  •  (42) 

Then  (9)  and  (10)  are  satisfied  with  Rq  =  0.  Furthermore,  the  performance  bound  (15)  is  given  by 

^(^?/)<tT(PV)  +  ptriV).  (43) 


Proof.  Since  P  >  0  and  PoiAA)  >  0,  AAe^,  it  follows  that  (10)  is  satisfied.  Next,  to  show  that  (9)  is  true,  recall 
that  QoiP)  is  given  by  equation  (36).  Therefore, 

QoiP)  -  [{A  +  J)^Po  +  PoiA  -f  a,J)2  -  a,(jTp  +  pj) 

=  5i( -P  +  rpj)  -  p{A'^  +  A)-  <Ti(J'^P  -i-  PJ) 

=  2pr\l2  +  dl{-P  +  J^PJ)  -  c7i(J^P  +  PJ) 


=  2p;/2  +  S 
=  S 


'/■i  01 

_o  ;.,J 


2ptj  -I-  Ai  0 

0  2firi  -I-  /2 


where  =  —  /.2  =  -I-  <5i  v^(P22  —  -Pu)^  +  (2Pi2)^  are  the  eigenvalues  of  di(  —  P  +  J'^PJ) - 

<Ti(J^P  -f  PJ)  and  S  is  a  2  X  2  orthogonal  matrix.  Choosing  p  according  to  (42)  implies  that  2pr]  4-  /i  >  0 
and  2pr]  -t-  /2  >  0.  Thus,  (9)  is  satisfied.  Finally,  the  performance  bound  (15)  has  the  form 


^{^)  <  tr  [(P  -I-  Po{AA))V^  =  tr(PF)  -I-  /itr(F).  □ 
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Remark  4.7.  As  in  [3, 4]  the  robust  performance  bounds  (40)  and  (43 )  are  only  valid  for  constant  uncertainty 

ffi. 


Before  we  present  a  numerical  example,  we  shall  illustrate  some  important  aspects  of  P  given  by  equation 
(37).  The  analytical  solution  for  (37)  yields 

^11  +  ^22  =  ^(^11  +  ^22)1  P 11  ~  P22  =  2  "(^11  ~  ^22)  ~  ^^^12^' 

(0  . 

—  (Rji  —  R22)  +  (7  +  )^i2  5 

where  ^  {rj  +  3l)^  +  to^ .  For  large  <5 1,  it  is  easy  to  see  that 


P11-P2: 


1  ~  ^22)^ 

2di 


2Pi2 


P12 


and 


lim  lAl,  P] 
<5,-1 


lim 

^  t  OO 


■  -2Pn 

Pn-P22 


PU-P22 
2Pi2  J 


=  0, 


which  agrees  with  Lemma  3.9.  Hence,  Pu  —  P22  and  P12  both  approach  zero  as  (5i  -►  00.  These  properties 
are  the  so-called  equipartition  (modal  energy  equilibration)  and  incoherence  (modal  decorrelation)  phe¬ 
nomena  [17,20].  Since 


Ji  ^  lim  M  = 

2rj 


+  R 


2 

12 » 


the  performance  bound  given  by  (43)  approaches  a  (finite)  constant  as  ^  oc.  Furthermore,  since 
lim  Pii  =  lim  Pjz  =  (1/4;/)  tr(P),  it  follows  that 

-*  X  5  1  “»  30 

lim  tr(PF)  -t-  fitT(V)  =  (:^-tr(P)  -l-  /i  )  tr(F). 

i.-x  \47  J 


We  now  compare  the  performance  bounds  given  by  (39)  and  (43)  for  large  values  of  <5i.  Denoting 
J'l  =  tr(F)tr(P)  and  ^2  =  tr(PF)  -f  iiix(V),  it  can  be  shown  using  Pj,  <  Pn  P22  that 


lim  —  ^2  = 


tr(F)rPn  +  P22 

27  L 


tr(F). 

2n 


(P)>0. 


(44) 


Finally,  if  det  P  =  0,  then  lim  =  lim  .^2  =  (l/2;/)tr(F)tr(P). 

5 1  ”♦  X  ^  I  -*  X 


5.  Numerical  examples 


Example  5.1.  Let  us  consider  a  lightly  damped  system  with  C  =  0.02,  co„  =  2,  t}  =  C(o„,  co  = 


CO 

0 

1 

A  = 

—  (D 

> 

“  'J  J 

J  = 

1 

o_ 

and  let 


P  = 


2P  O' 

0  2J’ 
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where  /f  >  0.  For  robust  stability,  we  compare  our  result  to  the  approach  of  [22],  For  R  ^  21 2  we  must  use 
a  congruence  transformation  in  order  to  apply  the  theorem  in  [22],  Hence,  we  transform 

A^P  +  PA  +  R  =  0  (45) 

to  obtain 

A'^P  +  PA  +  2/2  =  0, 

where  /4  ^  S~  MS,  and  S  is  the  congruence  transformation  matrix  such  that  S^RS  =  21 2.  As  was  mentioned 
in  Remark  4.3,  this  system  is  robustly  stable  for  all  <Ti6R.  This  follows  from  [22]  by  taking  ^  =  1,  that  is, 
R  =  2/2,  so  that  equation  (45)  has  the  solution  P  =  (l/;/)/2.  Therefore,  in  the  notation  of  [22], 
P\  -  2  +  PJ)  =  0,  and  thus  the  singular  values  of  P,  are  all  zero.  As  a  result,  the  robust  stability  region 

is  |(7i  1  <  X. 

Now  consider  the  case  0.  Following  the  same  procedure  mentioned  above,  we  have 
l^i !  <  ~  Q/(oP)  +  <y^)  as  ^  X.  Thus,  for  large  P  the  approach  of  [22]  becomes  highly  conservative. 

The  reason  for  this  conservatism  is  the  similarity  transformation  of  the  skew-symmetric  matrix  J  which  was 
effectively  imposed  by  the  choice  R  ¥=  2/2.  In  the  new  basis,  the  matrix  J  is  transformed  to  S~  ^JS,  which  is  no 
longer  skew-symmetric. 


Example  5.2.  Consider  the  same  system  in  Example  5.1  except  with 


and  for  robust  performance,  let 


First,  the  robust  stability  region  found  by  using  the  same  technique  as  in  the  previous  example  is  Ici  |  <  1.37, 
an  extremely  conservative  result.  As  in  the  previous  example,  the  reason  for  this  conservatism  is  due  to  the 
similarity  transformation  of  the  skew-symmetric  matrix  J.  In  the  new  basis,  the  matrix  J  is  transformed  to 
S~^JS,  which  is  no  longer  skew-symmetric. 

Next,  let  us  compare  the  robust  performance  bound  given  by  equation  (39)  in  Proposition  4.2  with  the 
bound  suggested  by  Bernstein  and  Haddad  [3].  According  to  (39)  the  performance  bound  is 
<  il/2tj )  tr  (R )  =  98.50,  which  is  valid  for  all  (Tj elR.  In  [3]  the  stability  region  and  performance  bound 
can  be  found  by  solving 

A^Pa  +  PaA  -f  /I  -t-  R  =  0  (46) 

and  by  determining  the  values  of  aj  such  that 


<^i(A]Pa+  PaAi)<A,  (47) 

where  /I  is  a  nonnegative-definite  matrix.  First,  letting  A  =  kl 2,  where  k  >  0,  it  can  be  shown  that  the 
solution  to  equation  (46)  is  R^=  P  -I-  (k/2t])l2,  where  P  is  the  solution  to  (45)  with 


Therefore,  we  have  the  performance  bound  <  tr(PF) -I- (k/2;7)  tr  (F)  with  robust  stability  region 

\<^i  \  ^  k/^-maxU^P  +  PJ)  (see  Fig.  1).  Alternatively,  choosing  /I  =  0.53R  yields  the  robust  stability  re¬ 
gion  -  2.57  <  <Ti  <  0.37  which  yields  the  symmetric  stability  region  |o-i|  <  0.37.  For  this  robust  stability 
region  the  performance  bound  ^{U)  <  118.20  (see  Fig.  2). 
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Fig.  I.  Comparison  of  different  robust  performance  bounds 


Fig.  2.  Comparison  of  different  robust  performance  bounds 


6.  Discussion  and  conclusions 

As  was  shown  in  Propositions  4.2  and  4.6,  the  maximum-entropy-type  Lyapunov  functions  correctly 
predict  unconditional  robust  stability  for  arbitrary  coordinates  and  thus,  effectively,  for  an  arbitrary  state 
space  basis.  In  addition,  the  performance  bounds  predicted  by  the  maximum-entropy  Lyapunov  function  are 
comparatively  tight,  even  for  large  whereas  the  bound  of  [3]  is  extremely  conservative  and  highly 
coordinate-dependent.  The  problem  of  choosing  an  appropriate  basis  may  be  relatively  benign  if  robust 
stability  analysis  is  performed  independently  of  robust  performance  analysis.  That  is,  for  robust  stability 
analysis  one  can  arbitrarily  choose  the  state  space  basis  to  produce  the  best  estimate  of  the  robust  stability 
region  without  regard  to  robust  performance.  However,  in  the  problem  of  robust  controller  synthesis  the 
basis  is  not  arbitrary  but  rather  is  dictated  by  the  weighting  matrices  V  and  R.  Thus,  the  fact  that  the 
maximum-entropy-type  Lyapunov  functions  provide  robust  stability  and  performance  bounds  that  are  only 
slightly  affected  by  the  choice  of  V  and  R  appears  to  be  a  desirable  feature  for  robust  controller  synthesis. 
This  may  explain  the  favorable  results  obtained  in  [2,5,6, 18, 19]. 
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Homotopy  Algorithm  for  Maximum  Entropy  Design 
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Maximum  enlropy  design  is  a  generalization  of  the  LQG  method  that  was  developed  to  enable  the  synthesis 
of  robust  control  laws  for  flexible  structures.  The  method  was  developed  by  Hyland  and  motivated  by  insights 
gained  from  statistical  energy  analysis.  Maximum  enlropy  design  has  been  used  successfully  in  control  design  for 
ground-based  structural  testbeds  and  certain  benchmark  problems.  The  maximum  entropy  design  equations 
consist  of  two  Riccati  equations  coupled  to  two  Lyapunov  equations.  When  the  uncertainly  is  zero,  the  equations 
decouple  and  the  Riccati  equations  become  the  standard  LQG  regulator  and  estimator  equations.  A  previous 
homotopy  algorithm  to  solve  the  coupled  equations  relies  on  an  iterative  scheme  that  exhibits  slow  convergence 
properties  as  the  uncertainly  level  is  increased.  This  paper  develops  a  new  homotopy  algorithm  that  does  not 
suffer  from  this  defect  and  in  fact  can  have  quadratic  convergence  rates  along  the  homotopy  curve.  Algorithms 
of  this  type  should  also  prove  effective  in  the  solution  of  other  sets  of  coupled  Riccati  and  Lyapunov  equations 
appearing  in  robust  control  theory. 


Nomenclature 


e 


(»■) 

m 


Ir 

(H", 
tr  Z 
vec(-) 


Y>Z 

r>z 

y/z 


y*z 


z* 

z" 


Z{:,k) 

Zijy  Zf  j,  or  Z(^i^j) 

0 


=  m -dimensional  column  vector  whose  /th 
element  equals  one  and  whose  additional 
elements  are  zeros 
=  r  xr  identity  matrix 
=  X  1  real  vectors,  rrtxn  real  matrices 
=  trace  of  square  matrix  Z 
=  invertible  linear  operator  defined  such 
that  vec(S)  4  [5,^ -  ij"]  S  €  (ft'’"'' 
where  Sj  6  denotes  the  yth  column 
of  5 

=  y  —  Z  is  positive  definite 
=  y  -  Z  is  nonnegative  definite 
=  matrix  whose  (i,j)  element  is  yij/Zijy 
y  and  Z  must  have  identical  dimensions 
(MATLAB  notation) 

=  Hadamard  product  of  Y  and  Z 
i[yijZij])y  Y  and  Z  must  have  identical 
dimensions 

=  complex  conjugate  of  the  matrix  Z 
=  complex  conjugate  transpose  of  the 
matrix  Z,  (Z*)^ 

=  Arth  row  of  the  matrix  Z  (MATLAB 
notation) 

=  )tth  column  of  the  matrix  Z  (MATLAB 
notation) 

=  (i,j)  element  of  matrix  Z 
=  Kronecker  product*"^ 


I.  Introduction 

The  linear-quadratic-Gaussian  (LQG)  compensator*  has 
been  developed  to  facilitate  the  design  of  control  laws  for 
complex,  multi-input/multi-output  (MIMO)  systems  such  as 
flexible  structures.  However,  it  is  well  known  that  an  LQG 
compensator  can  yield  a  closed-loop  system  with  arbitrarily 
poor  robustness  properties.^  This  deficiency  has  led  to  general¬ 
izations  of  LQG  that  allow  the  design  of  robust  controllers. 
One  such  generalization  of  LQG  is  the  maximum  entropy  con¬ 
trol  design  approach  that  was  originated  by  Hyland^  and  Bern- 
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stein  and  Hyland>^  Maximum  ^entropy  control  design  was 
developed  specifically  to  enable  robust  control  law  design  for 
flexible  structures,  in  particular,  this  design  technique  devel¬ 
ops  control  laws  that  are  insensitive  to  changes  in  the  (un¬ 
damped)  modal  frequencies.  The  approach  was  motivated  by 
insights  from  statistical  energy  analysis  and  has  proven  to  be 
an  effective  tool  in  the  design  of  robust  control  laws  for 
ground-based  flexible  structure  tesibeds*^'"^  and  for  certain 
benchmark  problems.®"*® 

The  rigorous  theoretical  foundation  for  maximum  entropy 
design  is  not  yet  complete.  However,  in  Ref.  11  it  is  shown 
that,  for  an  open-loop  system,  a  Lyapunov  function  based  on 
the  maximum  entropy  constraint  equation  predicts  uncondi¬ 
tional  stability  for  changes  in  the  undamped  natural  fre¬ 
quency.  The  results  of  Ref.  11  also  provide  evidence  that  the 
theoretical  foundation  of  maximum  entropy  analysis  and  de¬ 
sign  may  be  related  to  recent  robustness  results  based  on  pa¬ 
rameter-dependent  Lyapunov  functions.*^ 

The  computation  of  full-order  maximum  entropy  con¬ 
trollers  requires  the  solution  of  a  set  of  equations  consisting  of 
two  Riccati  equations  coupled  to  two  Lyapunov  equations.  If 
the  uncertainty  is  assumed  to  be  zero,  these  equations  decouple 
and  the  Riccati  equations  become  the  standard  LQG  Riccati 
equations.  A  homotopy  algorithm  for  solving  these  equations 
is  described  in  Ref,  13.  This  algorithm  is  based  on  first  solving 
an  LQG  problem  and  gradually  increasing  the  uncertainty 
level  until  the  desired  degree  of  robustness  is  achieved.  Unfor¬ 
tunately,  the  algorithm  of  Ref.  13  relies  on  an  iterative  scheme 
that  tends  to  have  increasingly  poor  convergence  properties  as 
the  uncertainty  level  is  increased. 

The  contribution  of  this  paper  is  the  development  of  a  new 
homotopy  algorithm  for  full-order  maximum  entropy  design. 
Unlike  the  previous  approach,  this  algorithm  can  have  quad¬ 
ratic  convergence  rates  along  the  homotopy  curve.  Algorithms 
of  this  type  should  also  prove  effective  in  the  solution  of  other 
sets  of  coupled  Riccati  and  Lyapunov  equations  appearing  in 
robust  control  theory  (e.g.,  Ref.  12).  The  algorithm  has  been 
implemented  in  MATLAB  and  is  illustrated  using  a  control 
problem  from  the  Active  Control  Technique  Evaluation  for 
Spacecraft  (ACES)  testbed  at  NASA  Marshall  Space  Flight 
Center  in  Huntsville,  Alabama,  A  useful  feature  of  maximum 
entropy  design,  seen  in  the  example,  is  that  it  often  produces 
controllers  that  are  effectively  reduced-order  controllers. 
Other  features  of  maximum  entropy  controllers  are  described 

in  Refs.  6  and  7.  r,  •  tt  ^  i 

The  paper  is  organized  as  follows.  Section  II  develops  the 

maximum  entropy  design  equations.  Section  III  gives  a  brief 
svnopsis  of  homotopy  methods.  Next,  Sec.  IV  develops  a  new 
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homotopy  algorithm  for  maximum  entropy  control  design. 
Section  V  illustrates  the  algorithm  using  a  17th-order  model  of 
one  of  the  transfer  functions  of  the  ACES  structure  at  NASA 
Marshall  Space  Flight  Center.  Finally,  Sec.  VI  discusses  the 
conclusions. 


II.  Maximum  Entropy  Design  Equations 

Consider  the  system 

x(t)  =  Ax{t)^  Bu(t)  +  w,(/) 
y{t)  =  Cx{t)  +  Du{t)  +  >V2(0 

where  X  6  (R"^  w  €  y  €  (R"•^  w,  €  (R^ms  white  disturbance 
noise  with  intensity  Kj  >  0,  wj  €  is  white  observation  noise 
with  intensity  K2>0,  and  and  W2  have  cross  correlation 
Fi2  €  It  is  assumed  that  (A,B)  is  stabilizable  and 

(A,  C)  is  delectable.  Also,  the  matrix  A  is  assumed  to  be  of 
the  form 

A  =  block  diag[/l^^\ 

where  A^^^  represents  the  dynamics  that  are  certain  and  A^^^ 
represents  the  nominal  dynamics  of  the  uncertain  modes  and  is 
in  real  normal  form;  for  example, 


A^^^  =  block  diag 


-  W]  —  P] 


-0)3  “  Py 


We  also  assume  that  only  the  modes  with  complex  eigenvalues, 
corresponding  to  the  2x2  blocks 


are  uncertain  and  that  the  uncertainty  patterns  >4/  €  (R"^  ^"-"are 
of  the  form 


,  0,...,0 


Ai  =  block  diag  0, . ..  ,0, 


Notice  that  the  Aj  correspond  to  errors  in  the  undamped  nat¬ 
ural  frequencies,  i.e.,  the  imaginary  part  of  the  eigenvalues. 

The  maximum  entropy  control  design  problem  is  stated  as 
follows.  Find  a  full-order  dynamic  compensator  (i.e.,  a  com¬ 
pensator  of  order  nx)y 

Xr{f)  =  AcXc(t)-^  BcyU) 

w(/)  =  -CcXcit) 

which  stabilizes  As,  defined  later,  and  minimizes  the  cost  func¬ 
tional 


There  is  currently  no  rigorous  justification  for  the  requirement 
that  As  be  stabilized,  but  extensive  numerical  examples  have 
shown  that  stability  of  As  insures  stability  of  the  nominal 
closed-loop  system.  Notice  that  if  no  uncertainty  is  assumed 
(i.e.,  a/40),  then  the  maximum  entropy  control  design  prob¬ 
lem  becomes  the  standard  LQG  problem.  The  solution  to  the 
maximum  entropy  problem  is  characterized  by  the  following 
theorem. 

Theorem  Suppose  (Ac,  Be,  Q)  solves  the  maximum 

entropy  control  design  problem.  Then,  there  exist  nonnega- 
tive-definite  matrices  Q,  P,  Q,  and  P  such  that  Ac,  Be,  and  Q 
are  given  by 

Ac^As  -BRj^Pa  -  +  QoVi'^DR^^Pa 

Bc^QaVl'^  Cc^Ri^Pa 


As  -  A  ol]A] 

and  the  following  conditions  are  satisfied: 

O^AlP+PAs+Ri-PfR.'^Po  +  t  a:A](P  +  P)Ai  (1) 

/=  1 

0  =  AsQ  +  QA]  +  K,  -  Q.Vf'Qj'  +  E  a}Ai{Q  +  Q)A]  (2) 

/=  ) 

0  =  (As-  '  C)’‘P  +  P(As  -  QJT  ’  C)  +  P/Pi"  'Pa  (3) 

0  =  (As-BR2'Po)Q  +  Q(As-BR{'P,f  +  Qcy^'Q!  (4) 

Remark  1 .  If  no  uncertainty  is  assumed  (i.e.,  a,-  4  0),  then 
Eqs.(l-4)  decouple,  Eqs.  (1)  and  (2)  become  the  standard 
LQG  regulator  and  estimator  Riccati  equations,  and  (Ac,  Be, 
Cc)  defined  in  Theorem  1  is  an  LQG  compensator. 

III.  Homotopy  Methods  for  the  Solution  of 
Nonlinear  Algebraic  Equations 

In  the  next  section,  we  present  a  homotopy  algorithm  for 
solving  the  maximum  entropy  design  equations  (1-4).  A  ho¬ 
motopy  is  a  continuous  deformation  of  one  function  into  an¬ 
other.  The  purpose  of  this  section  is  to  provide  a  very  brief 
description  of  homotopy  methods  for  finding  the  solutions  of 
nonlinear  algebraic  equations.  The  reader  is  referred  to 
Refs.  15-17  for  additional  details. 

The  basic  problem  is  as  follows.  Given  set  0  and  4>  con¬ 
tained  in  CR'*  and  a  mapping  :  6  — 4>,  find  solutions  to 

F(e)  =  0 


J(Ac,  Bc,Cc)  =  tr  QR 


where  Q  satisfies 


0  =  AsQ  +  Q^s  +  y+L  AiQA] 


Homotopy  methods  embed  the  problem  F(B)  =  0  in  a  larger 
problem.  In  particular,  let  //  :  0  x  [0,  1]  — (R'’  be  such  that  the 
following  conditions  exist: 

1)  H(e,  1)  =  F(^). 

2)  There  exists  at  least  one  known  ^  (R'’  that  is  a  solution 
to  H(',  0)  =  0,  i.e.. 


H(eo,  0)  =  0 


■4  +  -  E  •  ^4,  =  block  diag[>l,, 

2  /=  1 


BeC  Ac-BcDCc, 


^  OjcJ’  ''  [bsVJ:s  B^V^BJ, 


3)  There  exists  a  continuous  curve  (&(X),\)  in  (R"x[0,  1] 
such  that 

N(0(\),  X)  =  0  for  X  €  [0,  1] 


(6(0),  0)  =  (60,  0) 
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4)  The  curve  (0(X),  X)  is  differentiable. 

A  homotopy  algorithm  then  constructs  a  procedure  to  com¬ 
pute  the  actual  curve  (0(X),  X)  such  that  the  initial  solution  ^(0) 
is  transformed  to  a  desired  solution  ^(1)  satisfying 

0  =  //Wl),  \)  =  F{d{\)) 

Differentiating  X)  =  0  with  respect  to  X  yields  Davi- 

denko’s  differential  equation: 


0  =  >1.(X)Q{X)  +  Q{X)/1,(X)^+  ^',(X)  -  a(X)K-  '(X)e.(X)^ 
+  L  a-(X)AiQ(X)A^  +  "t  aM/0(X)/l[  (7) 

f  =  I  /  I 

0=  [/l,(X)-a(X)K-'(X)C(X)]^P(X) 

+  P  ( X)  [/I,  ( X)  -  a  ( X)  ( X)C(  X)] 

+  />.(X)^/?f'{X)P„(X)  (8) 


aw 

dd  dx  ax 


(5) 


Together  with  ^(O)  =  0o»  EQ-  (5)  defines  an  initial  value  prob¬ 
lem  that  by  numerical  integration  from  0  to  I  yields  the  de¬ 
sired  solution  ^(1).  Some  numerical  integration  schemes  are 
described  in  Ref.  17. 


0=  [>l,(X)-5(X)/?,-'(X)/>„(X)](2(X) 

+  (5(X)[>4,(X)-fl(X)^,-'(X)P,(X)]^ 
+  Q,iX)y2-\X)Qa{Xf 
where 


(9) 


IV.  Homotopy  Algorithm  for  Full-Order 
Maximum  Entropy  Control  Design 

This  section  presents  a  novel  homotopy  algorithm  that  can 
be  used  to  design  full-order  maximum  entropy  controllers.  The 
algorithm  is  based  on  explicitly  solving  the  four  coupled  max¬ 
imum  entropy  design  equations  given  in  Eqs.  (1-4). 


A.  Homotopy  Map 

To  define  the  homotopy  map  we  assume  that  the  plant  ma¬ 
trices  {A,  B,  C,  D),  the  cost-weighting  matrices  Ri,  R\2)> 
the  disturbance  matrices  ( K ,  V\i),  and  the  vector  of  uncer¬ 

tainty  weights  (a  €  CR"®)  are  functions  of  the  homotopy  param¬ 
eter  X  €  [0,  1].  In  particular,  the  following  is  assumed: 


A{\) 

C(X) 


B{\) 

D(\l 


Ao 

.Co 

y?i(X) 


■>1/  b; 

J  (. 

LC/  D;\ 

RnW 

RiW. 


^0 

.Co 


where 


L/?(X)  =  Lft^o  +  \{Liij  —  Lfio) 


and  L/?  0  and  L^  j  satisfy 


T 

^R,0  - 


A 

'  R^.o 

P12.0 

j  r  T  A 

'  Ru 

Rnj 

0 

^2.0_ 

.  ErjEpj = 

-^12,/ 

Ru. 

^".(X)  K,2(X) 

Lk^(X)  k/(X)J 


=  Ik(X)L?(X) 


where 


Lk{X)  —  Lj/o  +  ^{Cyj  —  Lyo) 


and  Lk.o  and  Lyj  satisfy 


By^oLy  Q  : 


•"1.0 

Klo 


^12,0 


^2,0  J 

a?(X)  =  alj  +  X(a^  ,•  -of^  ,), 


ByjByj  = 


ynj 


^\2J 


/  =  1, 


As{X)^a(\)+^-  t 

2  ,=  I 

PAX)^B{\VP(\)  +  RrAXV,  QA\)^Q[X)C{\V  + 

B.  Derivative  and  Correction  Equations 

The  homotopy  algorithm  presented  in  the  next  section  uses 
a  predictor/corrector  numerical  integration  scheme.  The  pre¬ 
dictor  steps  require  derivatives  [P(X),  Q(X),  P{\)  ^(X)), where 
M=dM/d\,  whereas  the  correction  step  is  based  on  using 
Newton  corrections,  denoted  here  as  (AP,  AQ,  A^  AQ).  Next 
we  derive  the  matrix  equations  that  can  be  used  to  solve  for  the 
derivatives  and  corrections.  For  notational  simplicity  we  omit 
the  argument  X  in  the  derived  equations. 


I,  Derivative  Equations 

Differentiating  Eqs.  (6-9)  with  respect  to  X  gives  the  follow¬ 
ing  coupled  matrix  equations: 


0  =  A^P  -l-  PAp  -l-  /?  4-  ^ 
/=  1 


ajA^PAi  +  t,  ajA]PAi 


(10) 


0  =  AqQ  +  Q^l  +  V+f,  a]AiQA]  +  f  oc]AiQA]  (11) 

/=!  /=l 

0  =  A^qP  +  PAq  +  R  +  GcQF  +  FQOc 

+  HlPKp  +  KlPHp  (12) 

0  =  ApQ  +  Qa^p  +y  +  GgPE  +  £PGb 

+  HqQK^  +  KqQH^  (13) 

where 

Ap^A,-BR2,i„,P„  Aq  ^  A,  -  Q,V2-^C 
R^A^,P+  PA,  +  A,  -  P^R^mAB^P  +  RJ2) 


Notice  that  at  X  =  0,  /i(X)  =  >lo,  P(X)  =  5o»---,a?(X)  =  ao,/. 
whereas  at  X=  l,y4(X)  =  y4/,  P(X)  =  . . .  ,a- (X)  =  a)/.  Some 

guidelines  for  choosing  the  initial  and  final  matrices  are  dis¬ 
cussed  later  in  Sec.  IV.C. 

The  homotopy  0  =  //((P,  Q,  P,  ^),X)  is  given  by  the  equa¬ 
tions 


-  (PP  +  Pi2)P2.mvPfl  -  P/P2.invPa 

+  E  «/.sq>l[(P  +  P)>4, 

/=! 

VkA,Q  +  QA\  +  K,  -  aK2,i„v(CQ  +  K^j) 


0  =  >1.(X)^P(X)  +  P(X)>1,(X)  +/?,(X)  -  PAX)'^R2{X)- 'PAX) 
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Ak[As-  a»"2.invC-  Q.H.i„vC  -  (QC^+ 

+  P[A.-  av'2.invt-  a^'2.invC  -  (0^’’+  K,2)^'2.invC] 

+  +^12)  (B^P  +  Pi2)^B2,myPa 

+  PjPl.imP s 

V  4  [/4,  -B/?2,i„vP.  -Mj.invP*  -fi/?2.inv(fi''/’  +/fr2)]  ^ 

+  ^  [;i,  - BPi-^P,  - BRi.,„.Pa  - BRz,i„y(B^P  +  /?[:)]  ^ 

+  G7^2,inv(0C'^+  ^^12)’^+  (.Q^^+  ^l2)^2,myQl 
Qa^2,myQa 

Cb  =  -BR2.iT,yB^,  Cc  =  -C^K^.invC,  E  =  Q,  /  =  P 
//p  =  BR  2,invPo  »  PIq  ~  Qa  ^,inv^»  “  ^rtj, 

Note  that  in  the  previous  equations  we  have  used  the  notations 


R2-^kR{\  I":-'. 


a,,sq  =  a] 


2.  Correction  Equations 

The  correction  equations  are  developed  with  X  at  some  fixed 
value,  say  X*.  The  derivation  of  the  correction  equations  is 
based  on  the  relationship  between  Newton’s  method  and  a 
particular  homotopy.  In  the  following  text  we  use  the  notation 


Let  / :  (R^-CR"  be  and  consider  the  equation 

0=/((9)  (14) 

If  is  the  current  approximation  to  the  solution  of  Eq.  (14), 
then  the  Newton  correction*^  A0  is  given  by 

A0=  (15) 


P*,  and  are  the  current  approximations  to  /^(X*),  G(A*)» 
/5(X*),  and  Q(\*)  and  that  £/>.  Eq,  Ep,  and  Eq  are,  respec¬ 
tively,  the  errors  in  Eqs.  (1-4)  with  X  =  X*  and  P(X),  0(^)> 
j^(X),  and  ^(X)  replaced  by  Q*,  P*,  and  Q*. 

We  next  form  the  homotopy 

(1  -j3)£p  =AlP(fi)  +  PW)A,  +Rt-  PA^fRi'Pai^) 

+  Z  a}A]P0)Ai  +  Z  otjA'^PmA,  (18) 

/-I  »“1 

(1  -0)Eq  =  A,Q(0)  +  QW)Al  +  P',  -  0,(0)^- ' a, 

+  t  ofAiQmA]  +  E  ajA,O(0)A]  (19) 

1-1  /^l 

(1  -0)Ep  =  [AsQaim^'cypi^) 

+  P(0)  [a,  -  QaW)  Vz'  'C]  +  PAfifR{'Pa(P)  (20) 

(1  -0)£^  =  [a,-BR2'PAP)]0{^) 

+  Q(l3)[A,-BR2-'PaW)Y+  (21) 

where 

As  -  A  +  a}A) 

/=  1 

P,  =  B^PW)  +  Qc  =  (2(0)C^+  K,2 

and  the  system  matrices  are  assumed  to  be  evaluated  at  X  -  X*, 
i.e.,  (>4, £2,... )=M(X*),£(X*),...,£i(X*),/?2(X*), 
...].  Differentiating  Eqs.  (18-21)  with  respect  to  /3  and  using 
Remark  4  to  make  the  replacements 


A/>  =  — 

d/3  ^  =  0 

.  dP 
AP  =  — 

j8  =  0 


d/3  1^=0 

d^l 


e4/(0<'')) 

Now',  let  be  an  approximation  to  6  satisfying  Eq.  (14). 
Then,  with  e  as  given  immediately  above,  construct  the  follow¬ 
ing  homotopy  to  solve  Eq.  (14): 

(l-/3)e=/(0(/3)),  /3€[0.  1)  (16) 

[Note  that  at  ^  =  0  Eq.  (16)  has  solution  e{O)  =  0<'\  whereas 
0(1)  satisfies  Eq.  (14)].  Then,  differentiating  Eq.  (16)  with  re¬ 
spect  to  /3  gives 

^  =_/'(()(/))-. e  (17) 

op  3  =  0 

Remark  2.  Note  that  the  Newton  correction  A0  in  Eq.  (15) 
and  the  derivative  30/5/3 |^=o  in  Eq.  (17)  are  identical.  Hence, 
the  Newton  correction  A0  can  be  found  by  constructing  a 
homotopy  of  the  form  of  Eq.  (16)  and  solving  for  the  resulting 
derivative  50/5013  =  0'  As  seen  later,  this  insight  is  particularly 
useful  when  deriving  Newton  corrections  for  equations  that 
have  a  matrix  structure.  It  is  also  of  interest  to  note  that  the 
homotopy  of  Eq,  (16)  is  appropriately  referred  to  in  some 
literature  as  a  “Newton  homotopy.”*^ 

Now,  we  use  the  insights  of  Remark  2  to  derive  the  equa¬ 
tions  that  need  to  be  solved  for  the  Newton  corrections 
(AP,  AQ,  AP,  A^).  We  begin  by  recalling  that  X  is  assumed  to 
have  some  fixed  value,  say  X*.  Also,  it  is  assumed  that  P*,  Q*, 


0  =  Al^P  +  ^PAp  +  £  +  E  a}A]^PAi 

1=1 

+  E  «]A]APAi  (22) 

1=  1 

"o 

0  =  AQ^Q  +  AQAl  +  K  +  E  a]A,AQA^i 

/■=  1 

+  E  o^^AAQa'^,  (23) 

/=  1 

0  =  /4pA£  +  ^PAq  +  R  +  Gc^QF  +  pAQGc 

+  Hi  APKp  +  Kl  APHp  (24) 

0  =  ApAQ  +  aQaI  +  K  +  GbAP£  +  £APGb 

+  HqAQKI  +  KqAQHI  (25) 

where 

ApkAs-  BR^^Pa,  /Iq  4.4,  -  G.I^2'‘C 
R=Ep,  V  =  Eq,  P=Efi,  K  =  £{5 
Gb^^-BRz'BI  C,  =  -C’'Kj-'C,  £  =  C,  P  =  p 
Hp  =  BR{'P,,  Hq  =  Q,V2-'C,  Kp  =  l„^,  = 
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Comparing  Eqs.  (22-25)  with  Eqs.  (10-13)  reveals  that  the 
derivative  and  correction  equations  are  identical  in  form.  Each 
set  of  equations  consists  of  four  coupled  Lyapunov  equations. 
Since  these  equations  are  linear,  by  using  Kronecker  products'"^ 
they  can  be  converted  to  the  vector  form  dx-b  where  for 
Eqs.  (22-25)  x  is  a  vector  containing  the  independent  elements 
of  AP,  AQ,  AP,  and  ^Q.  The  d  is  then  a  square  matrix  of 
dimension  Irix  (n^  +  1).  Inversion  of  d  is  hence  very  computa¬ 
tionally  intensive  for  even  relatively  small  problems  (e.g., 

^;f=10). 

Fortunately,  the  coupling  terms  described  by  the  summation 
terms  in  Eqs.  (22)  and  (23)  are  relatively  sparse.  In  particular, 
each  summation  has  only  3^^  independent  terms.  Hence,  a 
technique  similar  to  that  described  in  Ref.  19,  which  exploits 
this  sparseness,  can  be  used  to  efficiently  solve  Eqs.  (22-25)  [or 
equivalently  Eqs.  (10-13)].  The  details  of  the  solution  proce¬ 
dure  are  described  in  Appendix  B.  The  solution  procedure  re¬ 
lies  on  the  solution  of  a  maximum  entropy  Lyapunov  equation 
as  described  in  Appendix  A.  The  results  of  Appendix  A  are 
also  based  on  the  results  of  Ref.  19.  Both  Appendices  A  and  B 
rely  on  diagonalization  of  the  coefficient  matrices  of  each  of 
the  Lyapunov  equations.  Since  efficient  MATLAB  implemen¬ 
tation  requires  the  minimization  of  the  use  of /or  loops  ^  the 
solution  procedures  of  Appendices  A  and  B  implement  the 
techniques  of  Ref.  19  with  minimal  looping,  A  complete 
derivation  of  these  results  is  presented  in  Ref.  20. 

C.  Overview  of  the  Homotopy  Algorithm 

This  section  describes  the  general  logic  and  features  of 
the  homotopy  algorithm  for  full-order  maximum  entropy 
control.  It  is  assumed  that  the  designer  has  supplied  a  set 
of  system  matrices  Sf-{Af,  B/,  C/,  Z)/,  R2jy  Rnj* 
^2jyy\2jy<^/)  descdbing  the  optimization  problem  whose 
solution  is  desired.  In  addition,  it  is  assumed  that  the  de¬ 
signer  has  chosen  an  initial  set  of  related  system  matrices 
Sq==  (/4o,  .^0,  Coy  Doy  R\,Qy  ■^2,o»  ^12,0*  1^1. o»  ^.0*  o^o)  that 
has  an  easily  obtained  or  known  solution  (Pqi  2o-Po.  2o)  to 
the  maximum  entropy  design  equations.  Note  that  we  can 
always  choose  ao  =  0  in  which  case  (Po.  Qo» Qo)  cor¬ 
responds  to  an  LQG  problem  and  can  be  computed  using 
standard  Riccati  equation  and  Lyapunov  equation  solvers. 
In  practice,  we  often  choose  the  remaining  system  matrices 
to  have  equal  initial  and  final  values,  i.e.,  Af  =  AQ, 

RlJ-Rl,Qy^>  y  ^1.0*  ^2,/ =  ^2,0-  HOW- 

ever,  there  is  a  strong  rationale  for  allowing  these  matrices  to 
vary  during  the  homotopy.  For  example,  suppose  a  maximum 
entropy  controller  of  a  particular  robustness  (corresponding  to 
some  value  of  a)  is  designed  but  the  controller  authority  level 
is  not  desirable.  Then,  instead  of  changing  the  weights 
R\yR2yR\2y  y\y  ^2,  and  Ki2  to  reflect  the  desired  authority 
level,  solving  the  corresponding  LQG  problem  (that  is,  the 
problem  with  a  =  0),  and  then  using  the  homotopy  algorithm 
to  reinsert  the  robustness  (corresponding  to  the  original  value 
of  a),  we  can  use  the  homotopy  algorithm  to  modify  the 
weights  with  a  fixed  to  its  original  value.  Simi¬ 

larly,  we  can  modify  the  nominal  plant  matrices  AyB^C,  and 
D  with  a  fixed  to  reflect  new  data  concerning  the  plant. 

Later  we  present  an  outline  of  the  homotopy  algorithm.  This 
algorithm  describes  a  predictor/corrector  numerical  integra¬ 
tion  scheme.  The  prediction  step  uses  cubic  spline  prediction  as 
described  next. 

1,  Cubic  Spline  Prediction 

Here  we  use  the  notation  that  Xq,  X_  i ,  and  Xi  represent  the 
values  of  X  at,  respectively,  the  current  point  on  the  homotopy 
curve,  the  previous  point,  and  the  next  point.  Also,  A/  =  dM/ 
dX.  The  prediction  of  P(\\)  requires  P(Xo),  /^(Xq),  P(X_i), 
and  P(X^i).  In  particular, 

vec  [P(Xi)]  =  flo  +  +  ^^3^^ 

where  ao,  fli,  ^2*  and  are  computed  by  solving 


"  1  0  10 

vec  [P(X.|)] 

o 

1 

vec  [P(X.,)] 

2X.,  X^o  2Xo 

vec  [P(Xo)] 

Xl,  3X1,  X^o  3X^ 

vec  [P(Xo)] 

Note  that  if  P(X_i)  and  are  not  available  (as  occurs  at 

the  initial  iteration  of  the  homotopy  algorithm),  the  P(Xi)  is 
predicted  using  linear  prediction,  i.e., 

/>(X,)  =  P(Xo)  +  (Xi-Xo)P(Xo) 

2.  Outline  of  the  Homotopy  Algorithm 

Step  1:  Initialize  loop  =  0,  X  =  0,  AX  €  [0,  1],  S  =  So,  (P> 

Q,  P,  Q)  =  {Po.Qo.Po,<5(,). 

Step  2:  Let  loop  =  loop  -f  1 .  If  loop  =  1 ,  then  go  to  step  4. 

Step  3:  Advance  the  homotopy  parameter  X  and  predict 
the  corresponding  P{X),  Q(X),  P(X),  and  ^(X)  as  follows: 

3a:  Let  Xo  =  X. 

3b:  Let  X  =  Xo  +  AX.  .  ^ 

3c:  Compute  P(Xo),  Q(Xo),  P(Xo),  and  e(Xo)  using 
Eqs.  (10-13). 

3d:  If  loop  =  2,  predict  P(X),  Q(X),  P(X),  and  g(X)  using 
linear  prediction,  or  else  predict  P(X),  Q(X),  P(X),  and  2(X) 
using  cubic  spline  prediction. 

3e:  Compute  the  errors  (£/>,  Eq,  Ep,  E(^)  in  the  maximum 
entropy  equations  (1-4).  If  the  max(||£/>||,  H-EgiU  ||£^L 
||£^||)  satisfies  some  preassigned  tolerance,  then  continue. 
Otherwise  reduce  AX  and  go  to  step  3b. 

Step  4:  Correct  the  current  approximations  P(X),  Q(X), 
/(X),  and  ^(X)  as  follows. 

4a:  Compute  the  errors  (£p,  Eq.Ep,  Eq)  in  the  maximum 
entropy  equations  (1-4). 

4b:  Solve  Eqs.  (22-25)  for  ^P,  AQ,  AP,  and  aQ. 

4c:  Let 

P{\)  —  P{\)  +  AP,  QW  —  QW  +  AQ 

P{\)~-P(\)  +  AP,  +  AQ 

4d:  Recompute  the  errors  (£p,  £g,  £/5,  £^)  in  the  maxi¬ 
mum  entropy  equations  (1-4).  If  the  max  (||£pi| ,  ||£(2l| ,  ||£^il , 
||£^||)  satisfies  some  preassigned  tolerance,  then  continue. 
Otherwise  go  to  step  4b. 

Step  5:  If  X  =  1,  then  stop.  Otherwise  go  to  step  2. 

Remarks,  Since  the  corrections  of  step  4  correspond  to 
Newton  corrections,  quadratic  convergence  can  be  insured  by 
choosing  the  prediction  tolerance,  used  in  step  3e,  sufficiently 
small.  This  insures  that  along  the  homotopy  curve  the  approx¬ 
imation  to  (£(X),  G(X),  P(X),  ^(X))  is  close  to  the  optimal 
value  (P*(X),  Q*(X),  P*(X),  ^♦(X)),  Hence,  the  quadratic 
convergence  properties  of  Newton’s  method*®  can  be  realized. 
This  quadratic  convergence  has  been  observed  in  numerous 
examples. 

Remark  4.  The  previous  homotopy  algorithm  for  maxi¬ 
mum  entropy  design  advanced  the  P  and  Q  equations  sep¬ 
arately  from  the  P  andj^  equations.  That  is,  £(X)  and  Q(X) 
were  corrected  with  £(X)  =  Pff(X)  and  ^(X)  =  ^a(X)  where 
Pa(\)  and  ^a(X)  are  approximations.  Similarly,  P(X)  and 
^(X)  were  corrected  with  £(X)  =  £<,(X)  and  QW-  QaM 
where  £a(X)  and  Qo(X)  are  approximations.  This  iterative 
scheme  tends  to  converge  slowly  as  the  uncertainty  level  is 
increased  and  never  exhibits  quadratic  convergence,  no  matter 
how  small  the  prediction  tolerance. 

Notice  that  the  algorithm  relies  on  solving  four  coupled 
Lyapunov  equations  (10-13)  or  (22-25)  at  each  prediction  step 
or  correction  iteration.  Efficient  solution  of  these  equations 
makes  the  algorithm  feasible  for  large-scale  systems.  The  Ce¬ 
rent  solution  procedure  is  based  on  diagonalizing  the  coeffi¬ 
cient  matrices  Ap  and  Ag  of  the  coupled  Lyapunov  equations. 
This  is  usually  possible.  However,  it  is  possible  that  this  diag- 
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Table  1  Run-time  statistics  of  the  maximum 
entropy  homotopy  algorithm _ 


Initial 

Final  0 

Megaflops 

Real  time,  s 

Predictions  and 
corrections 

mm 

1246 

609 

43 

519 

36 

0.1 

1 

1062 

513 

36 

1 

5 

1212 

617 

41 

Table  2  Robustness  to  simultaneous  shifts 


in  the  undamped  natural  frequencies 

0 

Awmin,  rad/s 

AwniM,  rad/s 

0(  =  LQG) 

-0.000075 

0.0075 

0.01 

-0.0037 

0.036 

0.1 

-0.080 

0.69 

1 

-1.6 

7.1 

5 

-15 

94 

Fig.  1  Bode  plot  of  SISO  ACES  transfer  function. 


onalization  will  be  intractable  for  some  points  along  the  homo¬ 
topy  path.  In  this  case,  one  could  randomly  perturb  the  system 
matrices  so  that  diagonalization  is  possible.  The  perturbation 
is  then  removed  at  the  end  of  the  homotopy  curve.  This  type 
of  random  perturbation  is  commonly  used  in  “probability  one 
homotopies.*’*’  An  alternative  is  to  embed  a  numerical  condi¬ 
tioning  test  in  the  program  to  determine  whether  the  coeffi¬ 
cient  matrices  are  truly  diagonalizable.  If  they  are  not,  then 
one  can  solve  the  coupled  Lyapunov  equations  using  a  non¬ 
diagonal  alternative  such  as  the  Schur  decomposition. 

V.  Illustration  of  Maximum  Entropy  Design 
Using  the  ACES  Structure 

This  section  illustrates  the  design  of  a  maximum  entropy 
controller  for  a  17th-order  model  of  one  of  the  single-input/ 
single-output  (SISO)  transfer  functions  of  the  ACES  structure 
at  NASA  Marshall  Space  Flight  Center The  actuator  and 
sensor  are,  respectively,  a  torque  actuator  and  a  collocated  rate 
gyro.  The  model  includes  the  actuator  and  sensor  dynamics.  A 
first-order  all-pass  filter  was  appended  to  the  model  to  approx¬ 
imate  the  computational  delay  associated  with  digital  imple¬ 
mentation. 

The  Bode  plots  of  the  open-loop  plant  are  illustrated  in 
Fig.  1.  The  basic  control  objective  is  to  provide  damping  to  the 
lower  frequency  modes  of  the  structure  (i.e.,  the  modes  less 
than  3  Hz)  as  measured  by  the  rate  gyro.  The  undamped  natu¬ 
ral  frequencies  of  each  of  the  eight  flexible  modes  are  consid¬ 
ered  uncertain.  (Note  that  there  are  two  modes  at  2.4  Hz,  one 
of  which  is  virtually  unobservable.)  Maximum  entropy  design 
is  used  to  add  uncertainty  to  each  of  these  modal  frequencies 
to  increase  the  design  robustness.  The  uncertainty  vector 
a  €  61®  is  given  by 

a  =  0*00 

where  each  element  of  -oo  €  61®  has  unity  value,  reflecting 
equal  uncertainty  in  each  of  the  flexible  modes  and  /3  is  a  scale 
factor  chosen  to  represent  the  level  of  uncertainty.  The  precise 
relationship  between  /3  and  the  allowable  frequency  perturba¬ 
tions  is  not  currently  defined  by  maximum  entropy  theory. 

For  this  example,  the  MATLAB  implementation  of  the  max¬ 
imum  entropy  homotopy  algorithm  was  run  on  a  486,  66-MHz 
personal  computer.  The  only  system  matrix  that  was  allowed 
to  vary  was  a;  hence,  .4/  =  Ao,  =  Bo, . . . ,  Vuj  =  ^2.0*  Table 
1  shows  some  of  the  run-time  statistics  of  the  program.  The 
highest  uncertainty  design,  corresponding  to  /3  =  5,  was  ob¬ 
tained  in  approximately  37  min.  Notice  that  the  number  of 
flops  and  the  run  time  are  essentially  linear  with  respect  to  the 
log  of  the  scale  factor  /3.  This  general  trend  has  also  been 
observed  in  other  design  examples. 


MAGNITUDE  OF  CONTROLLERS 


Fig.  2  Magnitude  frequency  response  of  LQG  and  maximum  en¬ 
tropy  controllers. 


As  was  increased,  the  maximum  entropy  controllers  be¬ 
came  increasingly  more  tolerant  to  changes  in  the  (undamped) 
natural  frequencies.  Table  2  describes  the  robustness  proper¬ 
ties  of  the  closed-loop  systems  when  the  natural  frequencies  of 
the  open-loop  plant  were  simultaneously  shifted  by  Acj.  The 
parameter  corresponds  to  the  maximum  negative  fre¬ 

quency  shift,  whereas  Ao^^ax  corresponds  to  the  maximum  pos¬ 
itive  frequency  shift.  Notice  that  the  LQG  controller  is  very 
sensitive  to  perturbations  in  the  natural  frequencies.  The  max¬ 
imum  entropy  controller  corresponding  to  0  =  5  allowed  maxi¬ 
mum  perturbations  that  were  more  than  four  orders  of  magni¬ 
tude  greater  than  those  allowed  by  the  LQG  controller. 
Robustness  analysis  that  allows  independent  variations  in  the 
modal  frequencies  can  be  performed  fairly  nonconservatively 
by  using  theory  based  on  Popov  analysis  and  parameter-de- 
pendent  Lyapunov  functions. An  illustration  of  the  applica¬ 
tion  of  this  theory  is  given  in  Ref.  22. 

Figures  2  and  3  compare,  respectively,  the  magnitude  and 
phase  of  the  initial  LQG  controller  and  the  maximum  entropy 
controllers  corresponding  to  =  1  and  5.  Notice  that  the  /3  =  5 
controller  has  a  very  smooth  frequency  response  and  is  positive 
real  over  a  very  large  frequency  band,  giving  it  very  significant 
robustness.  The  magnitudes  of  the  closed-loop  transfer  func¬ 
tions  corresponding  to  the  LQG  compensator  and  /3  =  5  maxi¬ 
mum  entropy  compensator  are  shown  in  Fig.  4.  As  would  be 
expected,  the  nominal  performance  (measured  by  the  amount 
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PHASE  OF  CONTROLLERS 


Fig.  3  Phase  frequency  responses  of  LQG  and  maximum  entropy 
controllers. 


CLOSED-LOOP  TRANSFER  FUNCTION  MAGNITUDES 


Fig.  4  Magnitude  of  the  closed-loop  transfer  functions  correspond¬ 
ing  to  the  LQG  and  ^^5  maximum  entropy  controller. 


of  damping  in  the  modes  below  2  Hz)  of  the  maximum  entropy 
controller  was  significantly  less  than  that  provided  by  the  LQG 
controller.  However,  significant  damping  was  provided  by  this 
controller,  and  as  previously  discussed,  this  controller  is  much 
more  robust  than  the  LQG  compensator. 

The  smoothness  of  the  maximum  entropy  controller  corre¬ 
sponding  to  /?  =  5  indicates  that  its  effective  order  is  much  less 
than  17.  Using  balanced  controller  reduction a  fourth-order 
compensator  was  obtained  whose  frequency  response  is  nearly 
identical  to  that  of  the  17th-order  compensator.  The  ability  to 
produce  what  are  essentially  reduced-order  controllers  is  an 
important  practical  feature  of  maximum  entropy  design.  An¬ 
other  interesting  feature  of  maximum  entropy  design  is  that  it 
will  sometimes  widen  and  deepen  controller  notches  to  ro¬ 
bustly  gain  stabilize  certain  modes.  This  property  is  illustrated 
in  Refs.  6  and  7.  In  Ref.  8,  maximum  entropy  design  is  applied 
to  a  multi-input/multi-output  control  problem,  whereas  in 
Ref.  10  maximum  entropy  design  is  applied  to  a  neutrally  sta¬ 
ble  system. 


VI.  Conclusions 

This  paper  has  presented  a  new  homotopy  algorithm  for 
maximum  entropy  control  design.  The  example  of  the  previous 
section  illustrated  the  use  of  the  algorithm  using  a  medium 
scale  model  (17  states)  representing  a  transfer  function  of  the 


ACES  structure  at  NASA  Marshall  Space  Flight  Center,  Very 
robust  designs  were  obtained  in  a  reasonable  amount  of  time 
on  a  66-MHz,  486  personal  computer.  For  this  example,  an 
interesting  feature  of  the  most  robust  maximum  entropy  con¬ 
troller  was  that  it  was  essentially  a  reduced-order  controller. 
This  allowed  a  I7th-order  compensator  to  be  easily  reduced  to 
a  fourth-order  compensator  by  using  balanced  controller  re¬ 
duction.  The  frequency  responses  of  the  two  controllers  were 
essentially  identical,  indicating  that  the  reduced-order  con¬ 
troller  maintained  the  robustness  and  performance  properties 
of  the  full-order  controller.  Algorithms  of  the  type  described 
here  should  also  prove  effective  in  the  solution  of  other  sets  of 
coupled  Riccati  and  Lyapunov  equations  appearing  in  robust 
control  theory. 


Appendix  A:  Efficient  Computation  of  the  Solution 
to  the  Maximum  Entropy  Lyapunov  Equation 

The  Appendix  presents  a  solution  procedure  for  efficiently 
solving  for  Q  satisfying  the  n  x  /i  maximum  entropy  Lyapunov 
equation 


flo 


0  =  A,Q  +  QA^  +  K  +  D  ajA^QA] 

l«  I 


(Al) 


where 

Ai=e  (4(/ ))  e  (4{')  +iy-e  (4(/)  +  l)e  (4(/))  (A2) 

where  4  €  is  a  vector  with  distinct  elements,  each  of  which 
lies  in  the  interval  [1  /i],  and  e  :  [1, 2, . ,  n)  — (R”  is  defined 
by 


edk)^ 


0, 


i^k 

i^k 


It  is  assumed  that  Eq.  (Al)  has  a  unique  solution.  The  solution 
procedure  also  assumes  that  A  is  nondefective  and  is  based  on 
transforming  A  io  z  complex,  diagonal  matrix.  Details  of  the 
derivation  of  the  solution  procedure  are  given  in  Ref.  20. 

Let  ^  be  the  eigenvector  matrix  of  A ,  such  that 


A  = 


where  A  €  is  diagonal.  Then  premultiplying  and  post- 
multiplying  Eq.  (Al),  respectively,  by  and  yield 

0  =  A0+  OA*  + 


where 


and 


V  4  ♦-IK'J'-"  M[Q)  =  £  M,{Q) 

I- 1 


(A3) 


Mi(Q)  k 

The  solution  procedure  relies  on  the  following  definitions: 


,  {o3„  €  (R");  X  “  [All  A22  ' 

S  4  -diag'“*(XWrt  +  W/iX^) 

(A4) 

{A5) 
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where 

Mil  =  4  + 


where 


where 


f^Q.A 


Nil 

Nil 


(A6) 


NqI  = 

Nil  =  ((a*a)c-Jj) 

•[('«'*(4,  +  K®'J'(4, ;))] 

Nil  =  -  {<i(x*a)o>L) 

/>Q.„  4  (I-Nq,,S  MQ,a)-'NQ,a  (A7) 

Te  ^  S  MQ,„PQ,a  +  4  (A8) 


Summary  of  Solution  Procedure 

Stepl:  Compute  5,  Mg.a*  and  satisfying,  respec¬ 
tively,  Eqs.  (A4-A6). 

Step  2;  Compute  satisfying  Eq.  (A7). 

Step  3:  Compute  Tq  satisfying  Eq.  (A8). 

Step  4:  Compute  Q  satisfying 

vec  (Q)  =  r^S  vec(P0 

Step  5:  Compute  Q  satisfying  Eq.  (A3)  or  equivalently 
Q  = 

Remark  AJ.  An  intermediate  step  in  the  derivation  of  the 
solution  procedure  is  that 

vec  {M{Q))  =  Mq,^z(Q) 


where 


Z{Q)t 


z.i(G) 

222(0) 


Lz12(0), 


and 


Z2iAQ)^oc]'^ik,:)Q^%.k) 
ZiiAQ)^  -a?^(/:  +  l,:)e^"(Ar,:) 


Appendix  B:  Efficient  Computation  of  the  Solution 
to  Four  Coupled  Lyapunov  Equations  for 
Differentiation  and  Correction 

This  Appendix  develops  a  solution  procedure  for  efficiently 
solving  for  P,  Q,  P,  and  Q  satisfying  the  four  nxn  coupled 
Lyapunov  equations 

Q  =  Al+PAp  +  R  +  t  +  E  ajA^PAi  (Bl) 

/-I 

0  =  AgQ  +  QAl  +  K  +  E  ctjAiQA]  +  E  aM-O^y  (B2) 

/-I  I-  I 

0  =  +  PA  e  +  P  +  CcQfi  fiQOc  +  +  Pf^p  (B3) 

0  =  ApQ  +  -I-  1^  +  GbP£  +  £PGb  +  ^qQ  Q^q 

where  A,  is  defined  by  Eq.  (A2).  It  is  assumed  that  Eqs. 
(B1-B4)  have  a  unique  solution  (P,  G,  It  is  also  as¬ 

sumed  that  Ap  and  Aq  are  nondefective.  The  solution  proce¬ 
dure  is  based  on  transforming  A />  and  A^  to  complex  diagonal 
matrices.  The  results  of  Appendix  A  are  used  extensively.  The 
actual  solution  procedure  is  summarized  at  the  end  of  this 
Appendix. 

Let  '^p  and  be  the  eigenvector  matrix  of  Ap  and  Aq, 
such  that 


Ap  =  ^pAp'^~\  Aq^'^qKq'^q^  (B5) 

where  Ap  €  and  Aq  €  are  diagonal.  Substituting 
Eqs.  (B5)  into  Eqs.  (B1-B4)  yields 

0  =  K^pP  +  Pkp-¥li  +  Mp(P)  +  Kfp(P)  (B6) 

0  =  AqQ  +  Qki  +  V  +  Mq(Q)  +  Mq{Q)  (B7) 

0  =  A^P  +  PAq  +  P  +  OcQP  +  PQOc 

+  H’^PRp  +  K'^.PHp  {B8) 

0  =  ApQ  +  +  CSgP£  +  £POb  +  NqQRq 

+  KQ^Hi  (B9) 

where 

P='i^P'i'p,  e  =  (BIO) 

P='*iP'i'Q,  C  =  (BID 

P  =  '*^R^P,  K  = 'I'e  ‘ 


Mp(P)  =  E  a]-^'^A^i-ip^P^p'Ai-i!p 

MpCP)=  E  a]'ir’^pA^,^Q»P-iQ'A^-ip 

Mq{Q.)  =  E  ct^-^QAi-^QQ^iA^-^Q^^ 

/=  1 


/=  1 

Gc  =  ■^'gGc'i'e, 

GB  =  ^p'CB'ip’^ 

£  = 

Hp-^-ip'Hp-^Q, 

Hq  = 

Kp  = 

RQ=^p''i!Q 
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For  X  €  (R"  and  ^  the  functions  seig,  malpha,  and 

nalpha  are  defined  as  follows: 

5  =  seig(X) 

is  equivalent  to 

S  =  [-diag(\u„''  +  a,„X")]-' 

=  malpha(^) 

is  equivalent  to 

=  [M<'>  M‘’>] 

where 

A/®  =  4  +  4  + 

Na  =  nalpha  W 

is  equivalent  to 


where 

N<'>=  ((a*aK^:).[('I'*(4  +  a.„..  :)0u,„’') 

+  (w:’0^(4  +  ‘Jn„. :))] 

yv®  =  ((a.aK^j)*  [('{'•(4.  +  (a,„^0'I'(4,  :))] 

N®  =  -  ((a.a)a.^':)  *  [(>I'*(4  +  «„,,  •K®'*'(4.  O)] 

It  follows  from  the  results  of  Appendix  A  that  Eqs.  (B6) 
and  (B7)  can  be  expressed  as 

vec(P)  =  7>5/>vec(Mp(P))  +  TpSpvtc{R)  (B12) 

vec(Q)  =  TqSq  vec  {AifQ(Q))  +  TqSq  vec(  fO  (B13) 

where 

Tp  =  „  +  /„),  Tq  =  (S^A/g,aCQ,a  +  /n) 

Pp.a  =  Un-Np^aSpMpJ-'^Np^^ 

Qq,.  =  (4 -Ng,aSQMQ^„)-'NQ,, 

Sp  =  seig(XV),  5q  =  seig(X2) 

X/>  =  (Af.,11  A/>,22  A/>,„„]^ 

Xq  =  [Aq,i|  Ag,22  Aq,„„J^ 

A^/>,a  =  inalpha('i'?),  A/g  „  =  inaipha('i'g ' ) 


Using  standard  Kronecker  algebra,  we  can  express  Eqs.  (B8) 
and  (B9)  as 

vcc{P )  —  SqUp  i  ycc{P)  +  SqUq^[  vcc(^)  +  Sq  vcc(P  ) 

(B14) 

vec(2)  =  SpUp^i  vec(P)  +  SpUq^^  vec($)  +  Sp  vec(  K) 

(B15) 

where 

Up,  =  {Rl®H'^)  +  {Hl®R'^) 

(B16) 

UQ.x  =  {F^®Oc)  +  {Ol®fi) 

Up,2  =  {£^®Gb)  +  (01®!) 

(B17) 

Uq.2  =  (Rq®Pq)  +  (H^®Rq) 

Now,  from  the  results  of  Appendix  A,  we  can  write 

vec(Mp(.^))  =  Mp^„z(fi),  vec(Mg(^))  =  Mq_„z{.Q) 

(B18) 

zih  =  Np,o.y^c(P),  z(Q)  =  NQ..y^c(Q)  (B19) 

where 

Np^ct  =  nalpha('I^Q  •).  =  nalpha(SI^/>) 

Substituting,  Eqs.  (B12)and  (B13)  into  Eqs.  (B14)  and  (B15) 
gives 

vec(jP)  =  SqUp^\  7pSf> vec pi^P ^ 

+  SgC^gj  TgiSg  vec  4*  ^0  (B20) 

vec(^)  =  SpUp^2TpSpwtc{Mp(P)) 

+  SpUQ^iTQSQiMqiQi)  +  Qq  (B21) 

where 

pQ  =  SqUp^\  TpSp\QQ{R)  +  SqUq^\  rgSg  vec(p0  +  •Sg  \QQ(R  ) 

(B22) 

Qo  —  Spu p  2TpSp\tC{R)  +  Spc/g  2  7gSg  vec(  Po  +  S^vec(  y) 

(B23) 

Substituting  Eqs.  (B18)  into  Eqs.  {B20)  and  (B21)  gives 

vec(^)  =  C/p.i  TpSpMp^^ziP) 

+  *SQt/Q,l  TgSgA/g  )  +  PO  (B24) 

vec(^)  -  S?Up,2TpSpMp,,z(h 

+  SpUq^2TqSqMq^^z(Q)  +  Qo  (B25) 

Substituting  Eqs.  (B24)  and  (B25)  into  Eq.  (B19)  gives 

zih  =  Np^aS^  Up,i  TpSpMp,^z(P) 

+  Np,a^Q^Q,\  TQ^Q^Q,aZ{Q)  +  ^ P,aPo 
Z{Q)  =  NQ,aS?Up,2  TpSpMp^,Z(P) 

+  ^Q,a^P^Q,2PQSQMQ  fxZ(0)  4*  NQ,aQo 


Np^„  =  nalpha(^^*), 


=  nalpha  (^q) 
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or,  equivalently, 


where 


D\\  D\2 

'z{p) 

^P,aP0 

Dll  Du. 

_z{Q)_ 

\-hn  ~~  ^F,a^Q  ^P.  1  TpSpM p,o 


(B26) 


(B27) 


D]2=  -  Np^aSQUQ^\TQSQMQ^a 

Dll  ~  —  Nq^q^p^p.i'^p^p^ P,c^ 

Du  =  hn,  -  NQ,aS?UQ,2TQSQMQ,„ 

Finally,  substituting  Eqs.  (B18)  into  Eqs.  (B12)  and  (B13) 


(B28) 


gives 


vec(P)  =  TpSpMp^aZiP)  +  TpSpVCciR) 


(B29) 


vec($)  =  TgSQMg^aZiQ)  +  TqSqVQC(V)  (B30) 

Notice  from  Eqs.  (B16)  and  (B17)  that  t/p.i,  Uq,\,  Up,2> 

Uq^2  are  each  an  x  matrix.  The  storage  required  to  com¬ 
pute  these  matrices  is  hence  very  large  for  large  n.  To  avoid 
this  memory  requirement  it  is  possible  to  compute  pQ  and  Qq 
satisfying  Eqs.  (B22)  and  (B23)  and  Z)ii»  ^12  >  -^21 »  and  Du 
satisfying  Eqs,  (B27)  using  the  identity 

\ec(ADB)  =  (^^®>4)vec(r)) 


By  substituting  Eqs.  (B16)  and  (B17)  into  Eqs.  (B19),  (B27), 
and  (B28),  and  using  Eq.  (B29),  it  follows  that  po»  §o»  ^11 » 
Di2,  D2\,  and  D22  can  be  computed  using  the  following  algo¬ 
rithms,  In  these  algorithms  vec;  ‘  :  (R"  --  (R"  ^ "  is  understood  to 
be  the  operator  satisfying 


M  =  vec“*  (vec(M)) 

Algorithm  for  computation  of  po  and  §0* 

IVp  -  vec' ’  +  vec(i?)) 

Wq  =  vec~’  {(Mq^oPq^q'^  ^n)SQ'vQc{V)) 

Po  =  vcc{(Cc^^^QF^H^yVpKp)  +  (Gc}VqF  +  H^WpKp)^^R) 
qq  =  vec  {(Gb  WpE  -}-  Hq  ^VqKq  )  +  (Gp  ^pF  +  Hq  ^qKq  +  F) 
Algorithm  for  computation  of  Dn,  D^^  Dii,  and  D22'- 
Vp  =  TpSpAd P  ai  ^  FqSqMq  c, 


for  i-\:  Sria 

D,i(:,  i)  =  h„^-  J^p.cSQVtc{HpVp{:,  i)Kp  +  KpVp(:,  i)^Hp) 
Dni:,  i)  =  - O^  +  ^^KpC.  ;rc") 

/)  =  ~ NQ_„Spvec(HQVpV„  OKq  +KqVp{:,  i)^HQ) 

D22i:,  i)  =  /3n„  -  Nq.oSH^Q^Q^-'  ''>^Q  +^Q^Qi-’ 

Summary  of  Solution  Procedure 

Step  It  Construct  Cn,  D^^  -^21 »  and  D22  and  solve  Eq. 
(B26)  forz(P)  and2:(Q). 

Step  2:  Solve  Eqs.  (B29)  and  (B30)  for  P  and  Q. 

Step  3:  Solve  Eqs.  (B24)  and  (B25)  for  P  and  Q. 

Step 4:  Compute  P,  Q,  P,  and  Q,  satisfying  Eqs.  (BIO) 
and  (Bll),  or  equivalently 


Q  =  '*qQ*q 

Acknowledgments 

This  work  was  supported  by  Sandia  National  Laboratories 
under  Contract  54-7609  and  the  Air  Force  Office  of  Scientific 
Research  under  Contract  F49620-9 1-0019. 


References 

‘  Kwakernaak,  H.,  and  Sivan,  R.,  Linear  Optimal  Control  Systems, 

Wiley,  New  York,  1972.  .  .»  rcrt: 

2Doyle,  J.  C.,  “Guaranteed  Margins  for  LQG  Regulators,  IEEE 
Transactions  on  Automatic  Control,  Vol.  23,  Aug.  1978,  pp.  756,  757. 

3 Hyland,  D.  C.,  “Maximum  Entropy  Stochastic  Approach  to 
Controller  Design  for  Uncertain  Structural  Systems,**  Proceeding  of 
the  American  Control  Conference  (Arlington,  VA),  IEEE,  Piscai- 
away,  NJ,  1982,  pp.  680-688.  ,  „  .  .  , 

-^Bernstein,  D.  S.,  and  Hyland,  D.  C.,  “The  Optimal  Projection/ 
Maximum  Entropy  Approach  to  Designing  Low-Order,  Robust  Con¬ 
trollers  for  Flexible  Structures,*’  Proceedings  of  the  IEEE  Conference 
on  Decision  and  Control  (Fort  Lauderdale,  FL),  IEEE,  Piscataway, 
NJ,  1985,  pp.  745-752.  . 

SBernstein,  D.  S.,  and  Hyland,  D.  C.,  “The  Optimal  Projection 
Approach  to  Robust,  Fixed-Structure  Control  Design,”  Mechanics 
and  Control  of  Large  Flexible  Structures,  edited  by  J.  L.  Junkins, 
AlAA,  Washington,  DC,  1990,  pp.  237-293. 

^Collins,  E.  G.,  Jr.,  Phillips,  D.  J.,  and  Hyland,  D.  C.,  “Robust 
Decentralized  Control  Laws  for  the  ACES  Structure,”  Control  Sys¬ 
tems  Magazine,  Vol.  11,  April  1991,  pp.  62-70. 

■^Collins,  E.  G.,  Jr.,  King,  J.  A.,  Phillips,  D.  J.,  and  Hyland,  D. 
C.,  “High  Performance,  Accelerometer-Based  Control  of  the  Mini- 
MAST  Structure,”  Journal  of  Guidance,  Control,  and  Dynamics, 
Vol.  15,  No.  4,  1992,  pp.  885-892. 

SDavis,  L.  D.,  Hyland,  D.  C.,  and  Bernstein,  D.  S.,  “Application 
of  the  Maximum  Entropy  Design  Approach  to  the  Space  Control 
Laboratory  Experiment  (SCOLE),”  Final  Rept.  for  NASA  Contract 
NASI -17741,  NASA  Langley  Research  Center,  Langley,  VA,  Jan. 
1985. 

^Cheung,  M.-F.,  and  Yurkovich,  S.,  “On  the  Robustness  of  MEOP 
Design  Versus  Asymptotic  LQG  Synthesis,”  IEEE  Transactions  on 
Automatic  Control,  Vol.  33,  Nov.  1988,  pp.  1061-1065. 

JOCollins,  E.  G.,  Jr.,  King,  J.  A.,  and  Bernstein,  D.  S.,  “Applica¬ 
tion  of  Maximum  Entropy/Optimal  Projection  Design  Synthesis  to  a 
Benchmark  Problem,”  Journal  of  Guidance,  Control,  and  Dynamics, 
Vol.  15,  No.  5,  1992,  pp.  1094-1102. 

^Bernstein,  D.  S.,  Haddad,  W.  M.,  Hyland,  D.  C.,  and  Tyan,  F., 
“A  Maximum  Entropy-Type  Lyapunov  Function  for  Robust  Stability 
and  Performance  Analysis,”  Systems  and  Control  Letters,  Vol.  12, 
1993,  pp.  73-87. 

‘^Haddad,  W.  M.,  and  Bernstein,  D.  S.,  “Parameter-Dependent 
Lyapunov  Functions,  Constant  Real  Parameter  Uncertainty,  and  the 
Popov  Criterion  in  Robust  Analysis  and  Synthesis:  Part  1,  Part  2,” 
Proceedings  of  the  IEEE  Conference  on  Decision  and  Control 
(Brighton,  England,  UK),  IEEE,  Piscataway,  NJ.  1991,  pp. 
2274-2279,  2617-2623. 

‘^Collins,  E.  G.,  and  Richter,  S.,  “A  Homoiopy  Algorithm  for 
Synthesizing  Robust  Controllers  for  Flexible  Structures  Via  the  Maxi¬ 
mum  Entropy  Design  Equations,”  Third  Air  Force /NASA  Sympo¬ 
sium  on  Recent  Advances  in  Multidisciplinary  Analysis  and  Optimiza¬ 
tion  (San  Diego,  CA),  May  1990,  pp.  1449-1454. 

‘^Brewer,  J.  W.,  “Kronecker  Products  and  Matrix  Calculus  in  Sys¬ 
tem  Theory,”  IEEE  Transactions  on  Circuit  and  Systems,  Vol.  CAS- 
25,  No.  9,  1978,  pp.  772-781. 

‘^Garcia,  C.  B.,  and  Zangwill,  W.  I.,  Pathways  to  Solutions,  Fixed 
Points  and  Equilibria,  Prentice-Hall,  Englewood  Cliffs,  NJ,  1981. 

•^Richter,  S.  L.,  and  DeCarlo,  R.  A.,  “Continuation  Methods: 
Theory  and  Applications,”  IEEE  Transactions  on  Circuits  and  Sys¬ 
tems,  Vol.  CAS-30,  No.  6,  1983,  pp.  347-352. 

uwatson,  L.  T.,  “ALGORITHM  652  HOMPACK:  A  Suite  of 
Codes  for  Globally  Convergent  Homotopy  Algorithms,”  ACM 
Transactions  on  Mathematical  Software,  Vol.  13,  Sept.  1987,  pp.  281- 
310. 

'^Fletcher,  R.,  Practical  Methods  of  Optimization,  Wiley,  New 
York,  1987.* 

’^Richter,  S.,  Davis,  L.  D.,  and  Collins,  E.  G.,  Jr.,  “Efficient 


COLLINS,  DAVIS.  AND  RICHTER:  MAXIMUM  ENTROPY  DESIGN 


321 


Compulation  of  the  Solutions  to  Modified  Lyapunov  Equations,” 
SIAM  Journal  of  Matrix  Analysis  and  Applications,  Vol.  14,  No.  2, 
1993,  pp.  420-434. 

^OCollins.  E.  G.,  Jr.,  Davis,  L.  D.,  and  Richter,  S..  “Homotopy 
Algorithms  for  Hi  Optimal  Reduced-Order  Dynamic  Compensation 
and  Maximum  Entropy  Control,”  Final  Rept.  for  Contract  54-7609, 
Sandia  National  Lab.,  Albuquerque,  NM,  Aug.  1992. 

-Urwin,  R.  D.,  Jones,  V.  L.,  Rice,  S.  A.,  Seltzer,  S.  M.,  and  Tol- 
lison,  D.  J.,  “Active  Control  Technique  Evaluation  for  Spacecraft 
(ACES),”  Final  Rept.  to  Flight  Dynamics  Lab.  of  Wright  Aeronauti¬ 


cal  Labs,  AFWAL-TR-88-3038.  Wright-Paiierson  AFB.  OH.  June 
1988. 

"Collins,  E.  G.,  Jr.,  Haddad.  W.  M.,  and  Davis,  L.  D..  “Riccati 
Equation  Approaches  for  Small  Gain,  Positivity,  and  Popov  Robust¬ 
ness  Analysis,”  Journal  of  Guidance,  Control,  and  Dynamics,  Vol. 
17,  No.  2,  1994,  pp.  322-329;  also  Proceedings  of  the  1993  American 
Control  Conference ,  IEEE,  Piscataway,  NJ,  1993,  pp.  1079-1083. 

Yousuff,  A.,  and  Skelton,  R.  E.,  “A  Note  on  Balanced  Controller 
Reduction,”  IEEE  Transactions  on  Automatic  Control,  Vol.  AC-29. 
March  1984,  pp.  254-257. 


Cdmput^tidiial  Nonlinear  Mechanics  in 
j  j  j  j  Aerospace  Engineering 


Satya  N.  Atluri,  Editor 

This  new  book  describes  the  roie  of  nonlinear  computational  modeling  in  the  analysis  and  synthesis  of 
aerospace  systems  with  particular  reference  to  structural  integrity,  aerodynamics,  structural  optimization,  proba¬ 
bilistic  structural  mechanics,  fracture  mechanics,  aeroelasticity,  and  compressible  flows. 

Aerospace  and  mechanical  engineers  specializing  in  computational  sciences,  damage  tolerant  design,  struc¬ 
tures  technology,  aerodynamics,  and  computational  fluid  dynamics  will  find  this  text  a  valuable  resource. 

Contents:  Simplified  Computational  Methods  for  Elastic  and  Elastic-Plastic  Fracture  Problems  •  Field  Boundary  Element  Method  for  Nonlinear  Solid 
Mechanics  •  Nonlinear  Problems  of  Aeroelasticity  •  Finite  Element  Simulation  of  Compressible  Flows  with  Shocks  •  Fast  Projection  Algorithm  for 
Unstructured  Meshes  •  Control  of  Numerical  Diffusion  in  Computational  Modeling  of  Vortex  Flows  •  Stochastic  Computational  Mechanics  for 
Aerospace  Structures  •  Boundary  integral  Equation  Methods  for  Aerodynamics  •  Theory  and  Implementation  of  High-Order  Adaptive  /?p-Methods  for 
the  Analysis  of  Incompressible  Viscous  Flows  •  Probabilistic  Evaluation  of  Uncertainties  and  Risks  in  Aerospace  Components  •  Finite  Element 
Computation  of  Incompressible  Flows  •  Dynamic  Response  of  Rapidly  Heated  Space  Structures  •  Computation  of  Viscous  Compressible  Flows  Using 
an  Upwind  Algorithm  and  Unstructured  Meshes  •  Structural  Optimization  •  Nonlinear  Aeroelasticity  and  Chaos 


Place  your  order  today!  Call  1-800/682-AIAA 

American  Institute  of  Aeronautics  and  Astronautics 

Publications  Customer  Service,  9  Jay  Could  Ct.,  P.O.  Box  753,  Waldorf,  MO  20604 
FAX  301/043-0159  Phone  1  -800/682-2422  9  a.m.  -  5  p.m.  Eastern 


Progress  In  Astronautics  and  Aeronautics 

1992.  541  pp,  ilius..  Hardcover,  ISBN  1-56347-044-6 
AIAA  Members  $69.95,  Nonmembers  $99.95,  Order  #:  V-146(929) 

Sates  Tax:  CA  residents,  8.25%;  DC.  6%.  For  shipping  and  handling  add  S4.75  tor  1-4  books  (call 
for  rates  for  higher  quantities).  Orders  under  $100.00  must  be  prepaid.  Foreign  orders  must  be 
prepaid  and  include  a  $20.00  postal  surcharge.  Please  allow  4  weeks  for  delivery.  Prices  are  subject 
to  change  wrthout  notice.  Returns  will  be  accepted  within  30  days.  Non-U. S.  residents  are 
responsible  for  payment  of  any  taxes  required  by  their  government. 


Appendix  C: 

The  Multivariable  Parabola  Criterion  for  Robust  Controller  Synthesis: 

A  Riccati  Equation  Approach 


Harris  Corporation 


January  1995  00051.tex 


June  1992 


The  Multivariable  Parabola  Criterion  for 
Robust  Controller  Synthesis: 

A  Riccati  Equation  Approach 


by 


Wassim  M.  Haddad 
Department  of  Mechanical  and 
Aerospace  Engineering 
Florida  Institute  of  Technology 
Melbourne,  FL  32901 
(407)  768-8000  Ext.  7241 
(407)  984-8461  (FAX) 


Dennis  S.  Bernstein 
Department  of  Aerospace  Engineering 
The  University  of  Michigan 
Ann  Arbor,  MI  48109-2140 
(313)  764-3719 
(313)  763-0578  (FAX) 


Abstract 

In  1967  Bergen  and  Sapiro  derived  an  absolute  (frequency  domain)  stability  criterion  that  unifies 
the  classical  circle  and  Popov  criteria.  A  slightly  weaker  version  of  tliis  combined  criterion  has  a 
graphical  interpretation  in  the  Popov  (rather  that  Nyquist)  plane  in  terms  of  a  parabola.  Our  goal 
in  this  paper  is  to  generalize  the  parabola  criterion  in  terms  of  Riccati  equations.  Besides  poviding 
a  multivariable  extension,  this  formulation  clarifies  connections  to  state  space  bounded  real  and 
positive  real  theory  and  provides  the  necessary  means  for  robust  controller  synthesis. 
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1.  Introduction 

.  One  of  the  most  basic  issues  in  system  theory  is  the  stability  of  feedback  interconnections.  Four 
of  the  most  fundamental  results  concerning  stability  of  feedback  systems  are  the  small  gain,  posi¬ 
tivity,  circle,  and  Popov  theorems.  In  a  recent  paper  [6],  each  result  was  spedalized  to  the  problem 
of  robust  stability  involving  linear  uncertainty,  and  a  Lyapunov  function  framework  was  established 
providing  connections  between  these  dassical  results  and  robust  stability  via  state  space  methods. 
Furthermore,  it  was  pointed  out  in  [6]  that  both  gain  and  phase  properties  can  be  simultaneously 
accounted  for  by  means  of  the  cirde  criterion  which  yidds  the  small  gain  theorem  and  positivity 
theorem  as  special  cases.  It  is  important  to  note  that  since  positivity  theory  and  bounded  real 
theory  can  be  obtained  from  the  drde  criterion  and  vice  versa,  all  three  results  can  be  viewed  as 
equivalent  from  a  mathematical  point  of  view'.  However,  the  engineering  ramifications  of  the  ability 
to  include  phase  information  can  be  significant  [3].  As  shown  in  [G],  the  main  difference  between 
the  small  gain,  positivity,  and  drde  theorems  versus  the  Popov  theorem  is  that  the  former  results 
guarantee  robustness  with  respect  to  arbitrarily,  time- varying  uncertainty  while  the  latter  does  not. 
Tliis  is  not  surprising  since  the  Lyapunov  function  foundation  of  the  small  gain,  positivity,  and  dr¬ 
de  theorems  is  based  upon  conventional  or  fixed  Lyapunov  functions  which,  of  course,  guarantee 
stability  with  respect  to  arbitrarily,  time- varying  perturbations.  Since  time- varying  parameter  vari¬ 
ations  can  destabilize  a  system  even  when  the  parameter  variations  are  confined  to  a  region  in  which 
constant  variations  are  nondcstabiiizing,  a  feedback  controller  designed  for  time- varying  parameter 
variations  may  unnecessarily  sacrifice  performance  when  the  uncertain  real  parameters  are  actually 
constant. 

Whereas  the  small  gain,  positivity,  and  drde  results  are  based  upon  fixed  quadratic  Lyapunov 
functions,  the  Popov  result  is  based  upon  a  quadratic  Lyapunov  function  that  is  a  function  of 
the  parametric  uncertainty.  Thus,  in  effect,  the  Popov  result  guarantees  stability  by  means  of  a 
family  of  Lyapunov  functions.  For  robust  stability,  this  situation  corresponds  to  the  construction 
of  a  parameter-dependent  quadratic  Lyapunov  function  [7,8].  A  key  aspect  of  this  approach  (see 
[7,8])  is  the  fact  that  it  does  not  apply  to  arbitrarily  time-varying  uncertainties,  wliich  renders  it 
less  conservative  than  fixed  quadratic  Lyapunov  functions  (such  as  the  small  gain,  positivity,  and 
drde  results)  in  the  presence  of  real,  constant  parameter  uncertainty.  A  framework  for  parameter- 
dependent  Lyapunov  functions  was  recently  developed  in  [7,8].  An  immediate  application  of  this 
framework  is  the  reinterpretation  and  generalization  of  the  classical  Popov  criterion  as  a  parameter- 
dependent  Lyapunov  function  for  constant  linear  parametric  uncertainty. 
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The  main  contribution  of  tliis  paper  is  the  unification  of  the  circle  and  Popov  criteria  via  a 
parameter-dependent  Lyapunov  function  framework  that  yields  both  results  as  special  cases.  The 
unification  of  the  circle  and  Popov  criteria  per  se  is  not  new  to  tliis  paper.  Indeed,  a  parabola  test 
wliich  accomplishes  this  goal  was  originally  developed  in  [2]  and  further  studied  in  [10].  However, 
these  results  are  confined  to  SISO  systems  and  rely  on  graphical  techniques.  The  present  paper 
thus  has  four  specific  goals: 

1.  to  provide  a  general  framework  for  the  parabola  test  in  terms  of  parameter-dependent 
Lyapunov  functions  in  the  spirit  of  [7,8]; 

2.  to  obtain  a  state  space  characterization  of  the  parabola  test  via  Iliccati  equations; 

3.  to  obtain  a  multivariable  extension  of  the  parabola  test  for  parametric  uncertainty;  and 

4.  to  use  these  results  for  robust  controller  synthesis. 

To  illustrate  how  the  parabola  test  unifies  the  circle  and  Pojiov  criteria,  consider  the  plant  Gin 
a  feedback  configuration  with  uncertainty  block  A  as  shown  in  Figure  1.  Introducing  the  multiplier 
J+Ns  into  the  loop  yields  the  configuration  in  Figure  2.  Applying  positivity  to  the  transfer  function 
(/  -f  Ns)G  now  yields  the  familiar  Popov  test.  Next  consider  the  equivalent  formulation  shown  in 
Figure  3  which  involves  the  introduction  of  an  offset  transfer  function  Mi  inparallel  with  A  and  in 
feedback  about  G.  The  resulting  configuration  (Figure  4)  now  involves  a  sliifted  A  (by  Mi)  and  a 
bilinear  transformation  of  G.  Letting  Mi  =  0  recovers  the  Popov  formulation  while  N  =  0  yields 
the  circle  formulation.  The  simultaneous  presence  of  both  N  and  Mi  leads  to  the  parabola  test  [2]. 

Although  from  a  mathematical  point  of  view  the  use  of  shifts  and  bilinear  tansformations  leads 
to  equivalent  results,  the  use  of  these  transformations  can  yield  less  conservative  results  in  practice. 
In  addition,  since  these  transformations  do  not  commute  with  controller  optimization  techniques, 
they  must  be  introduced  at  an  early  stage  prior  to  the  synthesis  procedure. 
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Notation 


real  numbers,  r  x  s  real  matrices,  R'’^^ 

C,C’'^*,C’'  complex  numbers,  r  x  s  complex  matrices,  C''^^ 

E,tr,  Orx*  expectation,  trace,  r  X  s  zero  matrix 

A  complex  conjugate  of  A  6  C 

/r,(  )^,(  )*  r  X  r  identity,  transpose,  complex  conjugate  transpose 
tr,yo(  ),aniax  trace,  spectral  radius,  largest  singular  value 

S'',N’',P''  r  X  r  symmetric,  nonnegative-definite,  positive-definite  matrices 
^  ■^2  j  <  ^2  Z2  —  Zi  Q  N*",  Z2  ~  Z\  ^  P^,  Zi ,  Z2  G  S'" 

||Z|1f  [tr  ZZ*'^^^  (Frobenius  matrix  norm) 

Il■fl^(«)ll2  [(l/27r)  /  ||if(;w)l|^dw]^/2 

•/-CO 
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2.  Robust  Stability  and  Performance  Problems 

•  Let  U  C  denote  a  set  of  perturbations  AA  of  a  given  noininal  dynamics  matrix  A  € 

We  begin  by  considering  the  question  of  whether  or  not  A  +  AA  is  asymptotically  stable  for  all 

AA6U. 

Robust  Stability  Problem.  Determine  whether  the  linear  system 

x(t)  =  (A  +  AA)x(t),  t  6  [0,oo),  (2.1) 

is  asymptotically  stable  for  all  AA  G  It. 

To  consider  the  problem  of  robust  performance,  we  introduce  an  external  disturbance  model 
involving  white  noise  signals  as  in  standard  LQG  (H2)  theory.  The  robust  performance  problem 
concerns  the  worst-case  II2  norm,  that  is,  the  worst-case  (over  It)  of  the  expected  value  of  a 
quadratic  form  involving  outputs  z(t)  =  Ex(t),  where  E  G  R’^",  when  the  system  is  subjected  to 
a  standard  white  noise  disturbance  w(t)  G  R"*  with  weighting  D  G 

Robust  Performance  Problem.  For  the  disturbed  linear  system 

x(t)  =  (A  +  AA)x(t)  -1-  Dw{t),  t  G  [0, 00),  (2.2) 

z{t)  =  Ex{t),  (2.3) 

where  ti>(-)  is  a  zero-mean  d— dimensional  white  noise  signal  with  intensity  Jj,  determine  a  perfor¬ 
mance  bound  /?  satisfying 

J(U)=  sup  limsupE{||2(t)||2)  < /?.  (2.4) 

A>l€U  «-*oo 

As  shown  in  Section  5,  (2.2)  and  (2.3)  may  denote  a  control  system  in  closed-loop  configuration 
subjected  to  external  white  noise  disturbances  and  for  which  z(t)  denotes  the  state  and  control 
regulation  error. 

Of  course,  since  D  and  F’may  be  rank  deficient,  there  may  be  cases  in  which  a  finite  performance 
bound  /?  satisfying  (2.4)  exists  wliile  (2.1)  is  not  asymptotically  stable  over  IX.  In  practice,  however, 
robust  performance  is  mainly  of  interest  when  (2.1)  is  robustly  stable.  Next,  we  express  the  H2 
performance  measure  (2.4)  in  terms  of  the  observability  Grainian  for  the  pair  (A  -f  AA,£).  For 
convenience,  define  the  n  x  n  nonnegative-definite  matrices 

R  =  E^E,  V  =  DD'^. 


4 


Lemma  2.1.  Suppose  A  +  AA  is  asymptotically  stable  for  all  AA  €  It.  Then 

J(ll)  =  sup  tr  F^aV  =  sup  (|Ga/i(s)||L  (2-5) 

AAeU  AAGU 

where  F^a  €  R”’'"  is  the  unique,  nonnegative-definite  solution  to 


0  =  (A  +  AA)'^Faa 

+  Faa^A  +  AA)  -1-  R, 

(2.6) 

Gaa{s)  ^  E[3l 

-{A  +  AA)]-^D. 

(2.7) 

Proof.  See  [7,8].  □ 

In  the  present  paper  our  approach  is  to  obtain  robust  stability  as  a  consequence  of  sufficient 
conditions  for  robust  performance.  Such  conditions  are  developed  in  the  following  sections. 

3.  Robust  Stability  and  Performance  via  Parameter-Dependent  Lyapunov  Functions 

The  key  step  in  obtaining  robust  stability  and  performance  is  to  bound  the  uncertain  terms 
AA^F^a+F^a^A  in  the  Lyapunov  equation  (2.6)  by  means  of  a  parameter-dependent  or  adaptive 
bounding  function  f2(P,  AA)  which  guarantees  robust  stability  by  means  of  a  family  of  Lyapunov 
functions.  As  shown  in  [7,8],  this  framework  corresponds  to  the  construction  of  a  parameter- 
dependent  Lyapunov  function  that  guarantees  robust  stability.  As  discussed  in  [7,8],  a  key  feature 
of  tliis  approach  is  the  fact  that  it  constrains  the  class  of  allowable  time- varying  uncertainties  thus 
reducing  conservatism  in  the  presence  of  constant  real  parameter  uncertainty.  The  following  result 
is  fundamental  and  forms  the  basis  for  all  later  developments. 

Theorem  3.1.  Let  N”  — >  S”  and  Fo".  U  — S"  be  such  that 

AA'^F  -I-  FAA  <  f?o(P)  -  [A'^Fo(AA)  +  Fo{AA)A  +  AA'^Fo{AA)  +  Po(AA)AA], 

AA€U,P€N”, 

and  suppose  there  exists  P  6  N"  satisfying 

0  =  A'^P  +  FAA  Qo{F)  +  R 

and  such  that  P  -f  Po(AA)  is  nonnegative  definite  for  all  AA  €  U,  Then 

(A  +  AA,E)  is  detectable,  AA  G  If,  (3.3) 


(3.1) 

(3.2) 
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if  and  only  if 

A  +  AA  is  asymptotically  stable,  AA  €  U.  (3.4) 

In  this  case, 

<P  +  Po(A>l),  AA€lt,  (3.5) 

where  Pj^a  is  given  by  (2.9).  Therefore, 

J(U)  <tT  FV+  sup  tr  Po{AA)V.  (3.6) 

If,  in  addition,  there  exists  Pq  6  S'*  such  that 

Po(Ayl)  <  Po,  AA  e  U,  (3.7) 

then 

HU)  <  13,  (3.8) 

where 

/3  =  tr[(P  +  Po)n  (3.9) 

Proof.  We  stress  that  in  (3.1)  P  denotes  an  arbitrary  element  of  N**,  whereas  in  (3.2)  P  denotes 
a  specific  solution  of  the  modified  Lyapunov  equation.  This  minor  abuse  of  notation  considerably 
simplifies  the  presentation.  To  begin,  note  that  for  all  AA  6  R'*^'*,  (3.2)  is  equivalent  to 

0  =  (A  +  AA)'^P  +  P{A  +  A^)  +  A)(P)  -  {AA'^P  +  PAA)  +  R.  (3.10) 

Adding  and  subtracting  A'^Po(AA)  +  Po(AA)A  +  AA'^Po(AA)  +  Po(AA)AA  to  and  from  (3.10) 
yields 


0  =(A  +  AA)'^'(P  +  Po(AA))  +  (P  +  Po(AA))(A  +  AA) 

+  f?o(P)  -  [A'^Po(AA)  +  Po(AA)A  +  AA'^Po(AA)  +  Po(AA)AA]  (3.11) 

-  (AA'^P  +  PAA)  +  R. 


Hence,  by  assumption,  (3.11)  has  a  solution  P  e  N**  for  all  AA  €  R'*’'".  K  AA  is  restricted  to  the 
set  U  then,  by  (3.1),  the  expression 


l2o(P)  -  [A'^Po(AA)  +  Po(AA)A  +  AA'^Po(AA)  +  Po(AA)AA]  -  (AA'^P  +  PAA) 
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is  noiinegative  dcfuiilc.  Thus,  if  the  detectabihty  coiidiliuu  (3.3)  holds  for  all  A/1  €  U,  then  it 
follows  from  Theorem  3.6  of  [12]  that  (A  +  AA,[R  +  ^2{PyAA)  -  P  +  PAA)^^^)  is  detectable 
for  all  AA  €  It,  where 

f2(P,  AA)  =  Qq{P)  -  [ATPo(AA)  +  Po(AA)A  +  AA'^Po(AA)  +  Po(AA)AA].  (3.12) 

It  now  follows  from  (3.11)  and  Lemma  12.2  of  [12]  that  A  +  AA  is  asymptotically  stable  for  all 
AA  €  U.  Conversely,  if  A  +  AA  is  asymptotically  stable  for  all  AA  G  U,  then  (3.3)  is  immediate. 
Now,  subtracting  (2.9)  from  (3.11)  yields 

0  =  (A  +  AA)'^(P  +  Po(AA)  -  Pt,A)  +  (A  +  AA)(P  +  Po(AA)  -  Paa) 

+  f2o(P)  -  [ATPo(AA)  +  Po(AA)A  +  AA'^Po(AA)  +  Po(AA)AA]  (3.13) 
-  (AA'^P  +  PAA),  AA  €  U, 

or,  equivalently,  since  A  +  AA  is  asymptotically  stable  for  all  AA  €  U, 

F  'T* 

P  +  Pq{AA)  -  Paa  =  ‘  f?(P,  AA)  -  (AA'^P  +  PAA)]e<^+^^)‘dt  >  0,  AA  €  U, 

(3.14) 

which  implies  (3.5).  The  performance  bounds  (3.6),  (3.8)  are  now  an  immediate  consequence  of 
(2.8),  (3.5),  and  (3.7).  □ 

Note  that,  with  f2(P,  AA)  defined  by  (3.12),  condition  (3.1)  can  be  written  as 

AA'^P  +  PAA  < /3(P,AA),  AA  G  It,  P  G  N",  (3.15) 

where  f2(P,  AA)  is  a  function  of  the  uncertain  parameters  AA.  For  convenience  we  shall  say  that 
f2(‘,")  is  a  parameter-dependent  bounding  function  or,  to  be  consistent  with  [7,8],  a  parameter- 
dependent  Q -bound. 

Finally,  we  note  that  the  parameter-dependent  f2-bound  framework  establishing  robust  stability 
given  by  Theorem  3.1  is  equivalent  to  the  existence  of  a  parameter-dependent  Lyapunov  function 
of  the  form 

F(x)  =  x^(P  +  Po(AA))x 

which  also  establishes  robust  stability.  For  further  details  see  [6-8]. 
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4.  Construction  of  Parameter-Dependent  Lyapunov  Functions  and  Connections  to  the 
Multivariable  Parabola  Criterion 

In  this  section  we  assign  explicit  structure  to  the  set  U  and  the  parameter-dependent  bounding 
function  Specifically,  the  uncertainty  set  IC  is  defined  by 

U  =  {AA  e  AA  =  BqFCo,  where  F  G  J},  (4.1) 

where  ST  is  a  subset  of  the  set  IT,  wliich  is  defined  by 

{Fe  iF-Mif[{M2-Mi)-'^+{M2-Mi)-'^]{F-Mi)  <  {F  -  Mi)  + (F  -  Mif}. 

(4.2) 

In  (4.1)  and  (4.2),  Bq  G  and  Co  G  R"*®^"  are  fixed  matrices  denoting  the  structure  of  the 

uncertainty,  F  G  R”*®^*”®  is  an  uncertain  matrix,  and  Mi,  M2  are  ^ven  mo  x  mo  matrices  such 
that  (M2  —  Mi)~^  exists. 

Next,  we  digress  slightly  to  provide  simplified  characterizations  of  the  set  B’.  Define  the  subset 
'Jo  of  j  by 

'j'o  =  {F€3':  dct[/-(M2-Mi)-*(F-M,)]^0}.  (4.3) 

Proposition  4.1.  The  set  Jq  is  equivalently  characterized  by 

Jo  =  {F€  R”'®^’"®:  F  =  [I+F{M2  -  Mi)-^]-^ F  +  Mi, 
where  F  G  R”»®X’”®,  F  +  >  0,  and  det[/  +  F(M2  -  Mi)"^]  7^  0). 

Proof.  The  proof  is  an  immediate  consequence  of  Proposition  4.1  of  [7,8]  with  F  replaced  by 
F-Mi.  □ 

In  the  special  case  that  M2  —  Mi  is  positive  definite,  it  follows  from  Lemma  4.1  of  [8]  that  the 
condition  dct[/-fF(M2  —  Mi)“^]  7^  0  in  the  definition  of  To  is  automatically  satisfied.  In  tliis  case, 
we  have  the  following  norm  bound  inequality  on  F. 

Lemma  4.1.  Let  F  G  T  and  assume  that  M2  —  Mi  G  P”*®.  Then 

(^m&x(F  -  Ml)  <  an,ax(M2  “  Mi).  (4.4) 

Proof.  First  note  that  if  F  G  T,  then  M2  —  Mi  G  P’"®.  In  tliis  case  it  follows  from  (4.2)  that 
0  <  (F  -  Mi)'^[2(M2  -  Mi)-^](F  -  Ml)  <  (F  -  Mi)  -f  (F  -  Mif. 
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Hence,  F  £3"  implies 

Xn..x[{F  -  MifZiF  -  Ml)]  <  A„,,,[(F  -  Ml)  +  (F  -  Mi)T],  (4.5) 

where  Z  =  2(M2  —  Mi)~^,  Now,  since  {F  —  Mi)^Z(F  —  Mi)  and  (F  —  Mi)  +  (F  —  Mi)^  are 
nonnegative  dcllnite,  (4.5)  is  equivalent  to 

<T„,ax[(F  -  Mi)Tz(F  -  Ml)]  <  a„,.x[(F  -  Mi)  +  (F  -  Mi)^]  <  2a,„„(F  -  Mi).  (4.G) 

Next,  since  Z  €  P’"°,  Amin(^)-1^  <  Z  or,  equivalently,  amini^)^  <  Hence  (4.6)  implies 

cr^iniZ)a„,,[{F  -  Mi)'^{F  -  Mi)]  =  a„,x[(F  -  Mi)a„,„(Z)/(F  -  Mi)] 

<a,„ax[(F-Mi)Tz(F-Mi)] 

<2c7„,„(F-Mi).  (4.7) 

Using  crmax[(F  -  Mi)'^(F  -  Mi)]  =  a^ax(-f’  “  -^1)1  (4-7)  yields 

<^min(^)t^Lx(i"  -Mi)<  2a,„ax(F  -  Mi),  (4.8) 

which  proves  (4.4).  □ 

Next,  we  provide  further  simplification  of  the  set  S'  in  the  case  in  which  F, Mi,andM2  are 

symmetric  and  M2  —  Mi  is  positive  definite. 

Lemma  4.2.  Let  F,Mi,M2  €  S”*o  and  Mj-Mi  €  P'"“.  Then  (F-Mi)(M2-Mi)-^(F-Mi)  < 

F  —  Ml  if  and  only  if  Mi  <  F  <  M2 . 

Proof.  The  proof  follows  as  in  the  proof  of  Lemma  4.2  of  [7,8].  □ 

Thus,  in  the  case  in  wliicli  F,  M2, Mi  are  symmetric  and  M2  —  Mi  is  positive  definite,  the  set 
defined  by  (4.2)  becomes 

j",  =  {F  €  S'"":  Ml  <  F  <  Mj}.  (4.9) 

Note  that  if  F  in  S'  is  constrained  to  have  the  diagonal  structure  diag[Fi ,  F2 , . . . ,  Fmo],  then  Mu  < 

Ft  <  Mut  i  =  l,...,mo,  where  Ml  =  diag[Mii,Mi2, . . . ,Mimo]  and  M2  =  diag  [M21M22, . . . ,M2mo]l 
More  generally,  F  may  have  repeated  elements  and/or  blocks  in  the  diagonal  of  the  form  diag 
[■fl>-l^l,Fi,F2,.  . .  ,F,no]- 

For  the  structure  of  It  satisfying  (4.1),  the  parameter-dependent  bound  !?(•,•)  satisfying  (3.12) 
can  now  be  given  a  concrete  form.  However,  since  the  elements  A/4  in  It  are  parameterized  by  the 
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cloiiiciits  F  ill  iT,  for  couvciiiciicc  hi  tlic  following  rcBults  wo  ehall  write  lo{F)  in  place  of  f  o(A/l). 
Furthermore,  we  introduce  a  key  definition  that  will  be  used  in  subsequent  developments. 

Definition  4.1.  Let  Mx^Mz^N  €  R’"oxmo,  xhen  'J  and  N  are  compatible  if  {F  -  Mx)^ N  is 
symmetric  for  all  .F  €  5”.  Furthermore,  3^  and  N  are  strongly  compatible  if,  in  addition,  {F—Mx  N 
is  nonnegative-definite  for  all  F  £  3. 

Finally,  for  the  remainder  of  tliis  paper  we  assume  for  simplicity  that  —  Mx  is  positive 
definite.  In  this  case  it  follows  from  Lemma  4.1  that  there  exists  p  €  S”*®  such  that  [F—Mx  N  <  p 
for  all  F*  6  5". 

Proposition  4.2.  Let  Mx,M2,N  G  be  such  that  3  and  N  are  compatible  and 

-NCoBo  +  iiMi-Mxr^-NCoBo]'^  >0.  (4.10) 

Then  the  functions 

ih{P)  =  [Co  +  NCo{A  +  BoMxC)  +  Bjpf  [(Mj  -  -  NCqBo  +  ((Mj  -  Mi)"^  -  NCoBofy"^ 

•  [Co  -F  NCo{A  -1-  BoMxC)  +  BJP]  +  PBoMxCo  +  Cj MJ Bj P,  (4.11) 

i  ;  Po{F)  =  CJiF-MxfNCo,  (4.12) 

satisfy  (3.1)  with  It  given  by  (4.1). 

Proof.  Since  by  (4.3)  (M2  —  Mi)“^  —  NCqBq  -f  [(M2  —  Mi)"^  —  NCqBq]^  >  0  and  by  (4.2) 
F-Mx  +  iF-  Mif  -  (P  -  Mi)T[2(M2  -  Mx)-^]{F  -  Mx)  >  0  it  follows  that 

0  <  [[Co  +  NCoiA  +  BoMxCo)  +  BjP]  -  [(Mj  -  Mi)"'  -  NCqBo  +  {M2  -  Mi)"^  -  NCoBo)'^]{F  -  Mi)Co]^ 

.  [(M2  -  Mi)-^  -  NCoBo  -b  ((M2  -  Mi)-^  -  NCoBo)'^]-^ 

•  [[Co  +  NCo{A  +  PoMiCo)  +  BjP]  -  [(Mj  -  Mj)"^  -  NCoBo  +  ((M2  -  Mi)"*  -  NCoBo)'^]{F  -  Mi)Co] 
-I-  [(P  -  Ml)  +  (P  -  Mi)T  -  (P  -  Mi)'^[2(M2  -  Mi)-'](P  -  Ml)]  Co 

=  Qo{P)  -  PBoMxCo  -  Cj' Mi^'Pj'P  -  [Co  +  iVCo(>l  +  PqMiCo)  +  BjPf{F  -  Mi)Co 
-  Cj (P  -  Ml )T[Co  +  JVCo(A  +  PoMiCo)  +  BJ P] 

+  Cj{F  -  Mi)'^[(M2  -  Mi)-^  -  NCoBo  +  ((M2  -  Mi)  -  lVCoPo)'^l(P  -  Mi)Co 
+  Cj[{F  -  Ml)  +  (P  -  Mx)^  -  (P  -  Mi)'^[2(M2  -  Mi)-^](P  -  Mi)]Co 
=  l?o(P)  -  A^ejN'^iF  -  Mi)Co  -  CJm]^BJcJn'^{F  -  Mi)Co  -  PBoFCo 
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-  Cj(r  -  MifNCoA  -  Cj^(F  -  MifNCoBoMiCo  -  CJf'^BJP 

1  >; 

^  -  MifjVCoBo(F  -  Mi)Co  -  CjiF  -  Mif  B’^C^N'^^F  -  Mi)Co 

=  i2o(P)  -  [A'^Po(i=’)  +  PoiF)A  +  AA'^PoiF)  +  PoiF)AA]  -  [AA'^P  +  PA/1], 

which  proves  (3.1)  with  IC  given  by  (4.1).  □ 

Remark  4.1.  Note  that  by  setting  Mi  =  0,  one  recovers  the  parameter-dependent  i?-bound 
considered  in  [7,8]  which  corresponds  to  a  generalized  multivariable  version  of  the  Popov  criterion 
for  hnear  uncertainty. 

Remark  4.2.  Note  that,  unlike  the  results  of  [7,8],  Po(0)  =  —CJM^NCq  ^  0  and  i?o(P) 
is  not  nonnegative  definite.  For  further  discussion  on  indefinite  parameter-dependent  f2-bounds 
resulting  in  indefinite  lliccati/Lyapunov  type  equations  see  [4]. 

Next,  using  Theorem  3.1  and  Proposition  4.2  we  have  the  following  immediate  result. 

Theorem  4.1.  Let  Mi,M2,N  €  be  such  that  'S  and  N  are  strongly  compatible  and 

(4.3)  is  satisfied.  Furthermore,  suppose  there  exists  a  nonnegative-definite  matrix  P  satisfying 


0  =  (A  -1-  BoMiCofP  +  PiA  +  BoMiCo) 


-1-  [Co  -1-  NCoiA  +  BoMiCo)  +  PjPf  [(Mj  -  Mi)"^  -  iVCoPo  +  {{M2  -  Afi)"* 

-  NCoB„f]-' 

•  [Co  +  NCo{A  +  BoMiCo)  +  BJP]  +  R. 

(4.13) 

Then 

{A  -|-  Ai4,  E)  is  detectable,  Ai4  G  U, 

(4.14) 

if  and  only  if 

A  *t-  AA  is  asymptotically  stable,  A/1  G  It. 

(4.15) 

In  this  case, 

J(U)  <  tr  Py  -1-  sup  tr  Cj^(F  -  MifNCo  <  tr  [(P  +  Cj/iCo)F]. 

(4.16) 

Proof.  The  residt  is  a  direct  specialization  of  Theorem  3.1  using  Proposition  4.2.  We  only  note 
that  Pq(AA)  now  has  the  form  Po(P)  =  Cq  (F  —  Mi)^NCo-  Since  by  assuption  (F  —  Mi)'^N  >  0 
for  all  P  G  T  it  follows  that  P  +  Po(P)  is  nonnegative  definite  for  aU  P  G  T  as  requred  by  Theorem 
3.1.  □ 
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Remark  4.3.  The  cotidUioa  that  [F  —  Mi)^'N  =  N'^^F  -  Mi),  F  €  T,  represents  an 

I  '  • 

intimate  relationship  between  the  matrix  N  and  the  structure  3^.  For  example,  if  F  =  Filmoi  2uxd 
Ml  =  MJmot  then  N  can  be  an  arbitrary  nonnegative-definite  matrix.  Alternatively,  U  N  =  Nolmoi 
then  F  Mi  may  be  nondiagonai.  Of  course,  F  —  Mi  and  N  may  have  more  intricate  structure, 
for  example,  they  may  be  block  diagonal  with  commuting  blocks  situated  on  the  diagonal. 

Next,  we  establish  connections  between  the  parameter-dependent  bounding  function  formed 
by  (4.11)  and  (4.12)  and  the  classical  parabola  test  [2,10].  Furthermore,  by  exploiting  residts  from 
positivity  theory  it  is  possible  to  guarantee  the  existence  of  a  positive-definite  solution  to  (4.13). 
First,  however,  we  present  additional  notation  and  definitions  and  a  key  lemma  concerning  strongly 
positive  real  transfer  functions.  Let 


G(s) 


Ic 

Dl 

denote  a  state  space  realization  of  a  transfer  function  G{s),  that  is,  G(s)  =  C{sl  —  A)~^B  -J-  D. 
The  notation  “'~"”deuotes  a  miiiiiiial  realization.  Furthermore,  an  asymptotically  stable  transfer 
function  is  a  transfer  function  each  of  whose  poles  is  in  the  open  left  half  plane. 


A  square  transfer  function  G{s)  is  called  positive  real  [1,  p.  216]  if  1)  all  poles  of  G(5)  are 
in  the  dosed  left  half  plane  and  2)  G(s)  -1-  G‘(s)  is  nonnegative  definite  for  Re[s]  >  0.  A  square 
transfer  function  ^(s)  is  called  strictly  positive  »'ea/[9,ll]  if  1)  G{s)  is  asymptotically  stable  and  2) 
G(ju)  +  G*(ju;)  is  positive  definite  for  all  real  w.  Finally,  a  square  transfer  function  G'(s)  is  strongly 
positive  real  if  it  is  strictly  positive  real  and  D  +  >  0,  where  D  =  G{oo). 


Lemma  4.3.  Let  G(s)  — j — .  Then  the  following  statements  are  equivalent; 

i)  A  is  asymptotically  stable  and  G(5)  is  strongly  positive  real; 


ii)  D  -f  >  0  and  there  exist  positive-definite  matrices  P  and  R  such  that 


0  =  A^P  -[-  FA  -f  (C  -  B'^Pf{D  -h  D'^)-^{C  -  B'^P)  +  R.  (4.17) 


Proof.  See  [5]. 


□ 


Next,  using  Lemma  4.3  we  obtain  a  suflident  condition  for  the  existence  of  a  solution  to  (4.13). 


Theorem  4.2.  Let  G(s) 


min 


A  -i-  BqMiCo 


Cq  -f-  Af(7o(A  -f-  BqMiCq) 


-Bo 


{M2-Mi)-^  -NCoBol 


.  If  A  is 


asymptotically  stable  and  (j(5)  is  strongly  positive  real  then  there  exists  an  n  x  n  matrix  F  >  0 
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satisfying  (4.13).^  Conversely,  if  2(ilf2  —  M\)  ^  —  {NCqBq  +  NCqBo]  >  0  and  there  exists  P  >  0 

I  ■  ■  ■!'  .  ' 

satisfying  (4.13)  for  all  R  :>,0,  then  A  is  asymptotically  stable  and  G(a)  is  strongly  positive  real. 

Proof.  The  proof  is  an  immediate  consequence  of  Lemma  4.3.  □ 

Next,  we  show  that  Theorem  4.1  is  a  generalization  of  the  classical  parabola  test  [2]  for  the 
case  in  which  the  loop  sector- bounded  nonlinearity  is  used  to  represent  uncertainty.  First,  how¬ 
ever,  we  provide  a  generalization  of  the  parabola  criterion  for  multivariable  systems  with  diagonal 
nonlinearity  structure.  Specifically,  we  define  the  set  characterizing  a  class  of  sector- bounded 
memoryless  time  —  mvariant  nonlineaii ties.  Let  Mi,  M2  and  M2  —  Mi  be  given  positive-definite 
diagonal  matrices  and  define 

{<!>•.  {(f>- MiyY[{M2- Mi)-\4>- Miy)-y]<\i,  y 

and  <i){y)  =  [<?!>i(2/i),^2(j/2),...,<^mo(ymo)r}  • 

Note  that  for  Mi  =  diag[mi, 7712, . . .  and  M2  =  diag[mi,m2, . . .  ,mmo])  >  0,  i  = 

1, . . . ,  mo,  it  follows  that  each  component  <t>i{yi)  of  <f>  satisfies 

miVi  <  4>iiyi)yi  <miyi,  y,  £R,  i  = 


Theorem  4.3.  (The  Multivariable  Parabola  Criterion).  K  there  exists  a  nonnegative- 

definite  diagonal  matrix  N  such  that  (M2  —  M\)~^  -f  (/  -f  Ns){I  -f  G(s)Mi)~^G(s)  is  strongly 

positive  real,  where  G(s)  — - —  ,  then  the  negative  feedback  interconnection  of  G(s)  and 

L  G  0 1 

d>(’)  is  asymptotically  stable  for  all  <^(‘)  € 


,  then  the  negative  feedback  interconnection  of  G(s)  and 


Proof.  First  note  that  the  negative  feedback  interconnection  of  G(s)  and  <^(*)  has  the  state- 
space  description 


x(t)  =Ax(t)  -  B4>{y{i)), 
y{t)  =Cx{t). 


(4.18) 

(4.19) 


Now,  noting  that  [/-i-G(s)Mi]“^G(s)  corresponds  to  a  plant  G(s)  with  feedback  gain  Mi,  it  follows 
from  feedback  interconnection  manipulations  that  a  minimal  realization  for  [/-f  G(s)Mi]~^G(s)  is 
given  by 
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Similarly,  noting  that  5G(3)  ~ 

hag  a  minimal  realization  given  by 

■  ■  n  •  ,  ' 

r  ! 


it  follows  that  (M2—Mi)~^+{I+Ns){I+G{s)Mi)  ^G{s 


A-BM^C 

_  B  ] 

[caNC{A-BMiC) 

{M2-  Mi)-^  A  NCB\ 

Now  it  follows  from  Lemma  4.3  that  since  (Afj  ~  +  (/+  iVs)(/  +  G{s)Mi)  ^G{s)  is  strongly 

positive  real  there  exist  positive-definite  matrices  P  and  R  such  that 


0  =(A  -  BMiCfP  -f-  PiA  -  BMiC) 


+ 


C  -1-  NCiA  -  BMxC)  -  B'^P]^\{M2  -  Mi)"^  -f  NCB  -t-  ((M2  -  Mi)"*  -I-  NCBf 


-1 


[C  +  NC(A  -  BMiC)  -  B'^P]  +  R. 


(4.20) 


Next,  for  ^  define  the  Lyapunov  function 

[4>i{a)  —  m^a]N  iAa.  (^-21) 

The  coresponding  Lyapunov  derivative  is  given  by 

.ii;  ,i  i; '  i',; :  Vix)  =  P  4-  PA)x  —  ^ B^ Px  —  x^ PB<j)  2{4>  —  M\y)'^ Ny.  (4.22) 

4’;’  ■  •  I.',  I  I'l,,'  '  ,  .  ' 

Next,  using  (4.20),  noting  that  y  =  CAx  —  CBcf),  and  adding  and  subtracting  2{4>  -  Miyy{M2  - 
Mi)-i(<^-Miy)'  2{<i>-Miyfy,  2x'^C'^MiNCB<l>,  2x^A'^C'^NMiCx,  2x'^C'^MiB'^C'^N(i>,ajid 
2x'^ C'^ M\B'^ C'^ N MiC x\^  to  and  from  (4.22)  it  follows  (after  some  algebraic  manipulation)  that 

I 

F(x)  =  —x'^Rx  —  z  A  2{(f>  —  Mij/)^[(M2  —  Mi)~^{(f>  —  M\y)  —  y], 


\y(x)  =  x^Px  +  2 


m  V; 

S/ 

•=1  n 


where 

z  =[(M2  -  Mi)-^  -t-  NCB  +  ((M2  -  Mi)-^  +  NCBf]-^^^[C  +  NC{A  -  BMxC)  -  B'^ P]x 
-  [(M2  -  Mi)-^  -1-  NCB  +  ((M2  -  Mi)-^  A  NCB)^]^I\4>-  MxCx]. 

Since  R  is  positive  definite  and  (</>  —  Miy)^[(M2  —  Mi)"^(<^  —  Miy)  —  j/]  <  0  it  follows  that  V{x) 
is  negative  definite.  □ 

In  order  to  specialize  the  result  of  Theorem  4.3  to  robust  stability  with  constant  linear  param¬ 
eter  uncertainty,  consider  the  system 

i(t)  =  (A-f- A44)x(t),  (4.23) 
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where  Aid  €  U  aiid  U  is  defined  by 


ll  =  {AA:  AA=  -BFC,  F  =  diag[Fi,f2,. •  •  ,i=mo],  221i  <  <  m<,  t  =  l,...,mo). 


It  now  follows  from  Theorem  4.3  by  setting  ^(y)  —  Fy  =  FCx  that  A  +  AA  is  asymptotically 
stable  for  all  AA  G  IX. 


It  has  thus  been  shown  that  in  the  special  case  that  F  and  N  are  diagonal  nonnegative-definite 
matrices,  Theorem  4.1  (with  Bq  replaced  by  —Bq)  specializes  to  the  multivariable  parabola  criterion 
when  applied  to  linear  parameter  uncertainty.  This  is  not  surprising  since  in  this  case  the  Lyapunov 
function  (4.21)  that  establishes  robust  stability  takes  the  form 

mo  .y, 

y(x)  =  x^Px  +  25^/  {Fi-  m,)aiVida,  y,-  =  (Coa:),-,  (4-24) 

or,  equivalently, 

I  ■  ■  V  ;!'  V{x)  =  x'^Px  +  x'^C^(F- Mi)NCox  (4.25) 

and  ;thus  is' a  special  case  of  the  parameter-dependent  Lyapunov  function  discussed  earlier.  Note 
that  the  uncertain  parameters  are  not  allowed  to  be  arbitrarily  time-varying,  wliich  is  consistent 
with  the  fact  that  the  classical  parabola  criterion  is  restricted  to  time-invariant  nonlinearities.  i 

'  .  .  .  .  J  . 

^1;,^;  -Finally,  we  note  that,  in  the  case  in  which  Mi  =  0,  Theorem  4.3  specializes  to  the  multivari¬ 
able  Popov  criterion  considered  in  [7,8].  Alternatively,  retaining  Mi  and  setting  N  —  0  yields 
a  strongly  positive  real  requirement  on  {M2  —  Mi)~^  +  {I  +  G{s)Mi)~^G{s)  or,  equivalently, 
[(/  +  G{s)M2){I  +  (j(s)Mi)”*]  wliich  corresponds  to  the  multivariable  circle  criterion  considered 
in  [6]  with  the  restrictions  that  Mi, M2  be  diagonal  and  positive-definite. 

5.  Robust  Controller  Synthesis  via  the  Parabola  Riccati  Equation 

In  tliis  section  we  introduce  the  Robust  Stability  and  Performance  Problem  with  static  output 
feedback  control.  Tliis  problem  involves  a  set  U  C  of  uncertain  perturbations  AA  of  the 

nominal  system  matrix  A. 

Robust  Stability  and  Performance  Problem.  Given  the  nth-order  stabilizable  plant  with 
constant  real-valued  plant  parameter  variations 


i(t)  =  (A  -h  AA)i(t)  -1-  Bu{t)  -h  Dw{i),  t  e  [0, 00),  (5.1) 

y{t)  =  Cx{t),  (5.2) 
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where  u(f)  G  W^,w(t)  6  and  y(t)  G  R^,  determine  a  static  output  feedback  control  law 
:  :  |  -  ■  :  .  .  \  u{t)  =  Ky{t)  (5.3) 

that  satisfies  the  following  design  criteria: 

i)  the  closed-loop  system  (5.1)  -  (5.3)  is  asymptotically  stable  for  all  AA  G  U,  that  is,  A  A 
BKC  +  A  A  is  asymptotically  stable  for  all  A  A  G  It;  and 


ii)  the  performance  functional 

J(/i')  =  sup  limsup-E<  f [x^{3)Rix{s)  +  u^{s)R2u{s)]ds 

AAeU  t-^oo  t  J 


(  t 


is  minimized. 


For  each  variation  AA  G  It,  the  closed-loop  system  (5.1)-(5.3)  can  be  written  as 


c!  ■  ' 

,  ■  n'i;;;!  -i  !'.■ 


x{t)  =  (A  -I-  AA)x(<)  -f  Dw{t)y  t  G  [0,oo), 


where 

'  •  !  ,  .--I? 

•  i'  i'!’!' j 


(5.4) 


(5.5) 


(5-6) 


/I  =  /I  +  BKC, 

and  where  the  wliite  noise  disturbance  has  intensity  V  =  VD^ .  Finally,  note  if  A  +  AA  is  asymp¬ 
totically  stable  for  all  AA  G  It  for  a  given  K,  then  (5.4)  can  be  written  as 


J{K)=  sup  ti  P/^aV, 
AAeU 


(5.7) 


where  P^a  satisfies  (2.6)  with  A  replaced  by  A  and  R  replaced  by 


R  =  Ri  -f  C'^K'^RiKC. 


(5.8) 


To  apply  Theorem  4.1  to  controller  synthesis  we  consider  the  performance  bound  (3.9)  in  place 
of  the  actual  worst-case  H2  performance  as  in  Theorem  4.1  with  A,il  replaced  by  A  and  R  to 
address  the  closed-loop  control  problem.  This  leads  to  the  following  optimization  problem. 

Auxiliary  Minimization  Problem.  Determine  K  G  that  minimizes 

i.  3{K)  =  U[{P  +  Cj  iiCo)V]  (5.9) 
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subject  to 


''e 

/-I  :  \  }  a\ 


'  I!  0  M(A+  BoMiCofP  -f  P{A  +  BoMiCo) 

:  .  +  [Co  +  NCoiA  +  BoMiCo)  +  BjPfUMi  -  -  NCoBo  +  ((Mj  -  Afi)-‘  -  NCoBof]-^ 

•  [Co  +  iVCo(A  +  BoMiCo)  +  +  R.  (5.10) 

It  follows  from  Theorem  4.1  that  the  satisfaction  of  (5.10)  along  with  the  detectability  condition 
(A  +  AA,fl)  leads  to  closed-loop  robust  stability  along  with  robust  II2  performance. 

Next,  we  present  sufficient  conditions  for  robust  stability  and  performcince  for  the  static  output 
feedback  case.  For  arbitrary  P,Q  £  define  the  notation 

Ro  =(M2  -  Mi)-^  -  NCoBo  +  ((M2  -  Mi)-^  -  NCoi?o)’^  , 


R2a  =R2  +  B'^'CJN'^Ro^NCoB, 


Pa  =B^P  B'^CJn'^Rq^Co  +  .B"Co"iV"/Zo"'NCo(A  -f  BoMiCo)  +  B^QN^^B^P, 


jT/^T  nrT  n-l 


T/oT  \tT  n-1  r>T  : 


;  when  the  indicated  inverses  exist. 


£!k  « 

VL=  In-  I', 


;!r:;u  jili  jTihebrem  ,5.1.  Assuixie  ilo  >  0  and  assume  T  and  N  are  strongly  compatible.  Furthermore, 

:  iii  ^  ■  ■■  i 

I ‘■;'s  suppose; there; ^xist  n  x  n  nonnegative-definite  matrices  P,Q  such  that  CQC"  >  0  and 


'I'.':"'?. 


,  li'i.  I 


;:jp^[A  4^  5oMiCo  +  BoR^^Co  +  BqR^^NCo{A  -1-  BqMxCq)]^ P 

■  +  P[A  +  BqMiCq  +  BqRq  ^Cq  +  BqRq  ^iVCo(A  +  BqM\Cq)\  -f-  R\ 

+  [Co  +  ACo(A  +  PoMiCo)PPo~^[Co  +  iVCo(A  +  BqMiCo)] 

-1-  PBoRo^BjP  -  PjRJ^Pa  -  ulPjR^^PaUj.,  (5.11) 

0  =[A  -  BR^^PaU  +  BoMiCo  +  PoPo"^^<^o(A  -  BRJ^PaU  +  BoMiCo)  +  BoRq^Co  +  BoRo^bJP]Q 
+  Q[A  -  BRl^^PaU  -1-  PoMiCo  +  i?oi2^^NCo(A  -  BR^^PaU  +  BoMiCo) 


+  BoRo^Co  +  BoRo^B^P]'^  +  F, 


and  let  K  be  given  by 


(5.12) 


(5.13) 


Then  (A  AA,i2)  is  detectable  for  all  AA  €  It  if  and  only  if  A  -|-  AA  is  asymptotically  stable  for 
all  AA  €  It.  In  this  case  the  closed-loop  system  performance  (5.7)  satisfies  the  bound 


J(K)  <  tr[(P  +  CjpCo)F]. 


(5.14) 
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Proof.  The  proof  follows  as  in  the  proof  given  in  [7].  □ 

?;■  ,  Theorem  6.1  provides  constructive  sufficient  conditions  that  yield  static  output  feedback  con¬ 
trollers  for  robust  stability  and  performance.  These  conditions  comprise  a  system  of  one  modified 
algebraic  Riccati  equation  and  one  modihed  Lyapunov  equation  in  variables  P  and  Q,  respectively. 
Finally,  note  when  solving  (5.11)  and  (5.12)  numerically,  the  matrices  Mi, M2  and  N  and  the  struc¬ 
ture  matrices  Bq  and  Co  appearing  in  the  design  equations  can  be  adjusted  to  examine  tradeoffs 
between  performance  and  robustness.  To  further  reduce  conservatism,  one  can  view  the  multiplier 
matrix  N  as  &  free  parameter  and  optimize  N  with  respect  to  the  worst  case  H2  performance  bound 
3.  In  particular,  computing  2J/20  =  0  yields 

0  =l/2tiCoVCj  -1-  [(M-^  -  NCoBo)  +  {M'^  -  NCoBo)]-^ 

•  [Co  -1-  NCo(A  -1-  BoMiCo)  -h  bJP]Q{A  -|-  PoMiCo)'^Co^ 

!  ■  ■  '  •  I  1'  ■  I ;  ' 

I;  +  [(M-^  -  NCqBo)  +  {M-^  -  NCoBofr^Co  +  NCo{A  +  BqMiCo)  +  P]Q 

I  ‘  i  _  I 

[Co  +  iVCo(i'+  BoMiCo)  +  BjPf[{M-^  -  NCoBo)  +  (M"*  -  NCoBofr^BjCj. 

•  !  |i:  [;V| ;  •'  I  j  J  \  '  ,  .  i  ’ 

!■!  1;  ii,  No\v,  the  basic  approach  is  to  design  the  controller  for  a  given  N  and  then  compute  the  optimal 

i  ijValue  of  iV  for  that  controller.  Hence,  tliis  design  procedure  will  involve  an  interaction  between 

1'  1  controller  design  and  evaluation  of  the  multiplier  N  until  convergence  in  N  is  achieved. 

!  I  ';J- 

Next,  we  specialize  Theorem  5.1  to  the  full-state  feedback  case.  When  the  full  state  is  available, 
that  is,  C  =  In,  the  projection  1/  =  /„  so  that  i/x  =  0.  In  this  case  (5.13)  becomes 

K  =  -Rj^Pa  (5.15) 

and  (5.11),  (5.12)  collapse  to  the  single  equation 

0  =[A  +  BoMiCo  +  BoRo^Co  +  BoRo^NCo{A  -f  BoMlCo}^'^P 

+  P[A  -f  BoMiCo  +  BoR^^Co  -t-  BoR^^NCo{A  -}-  BoMiCo)]  +  Ri 
-t-  [Co  +  NCo{A  -f  BoMiCq)]'^ R^^[Co  +  NCo(A  +  BqMiCo)] 

+  PBoRo^B'^P-PjR^^Pa.  (5.16) 
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6.  Dynamic  Output  Feedback  Controller  Synthesis 

Ill  this  section  we  introduce  the  Dynamic  Robust  Stability  and  Performance  Problem.  For 
simplicity  we  restrict  our  attention  to  controllers  of  order  Uc  =  n,  that  is,  controllers  whose  order 
is  equal  to  the  dimension  of  the  plant 

Dynamic  Robust  Stability  and  Performance  Problem.  Given  the  nth-order  stabllizable 
and  detectable  plant  with  constant  structured  real-valued  plant  parameter  variations 


x{t)  =(A  -f  AA)i(t)  -1-  Bu{i)  D\w{t),  t  >  0,  (6.1) 

y{t)  =Cx{t)  -f  D2‘w{t),  (6.2) 

where  u{t)  G  G  and  y(t)  G  determine  an  nth-order  dynamic  compensator 

®c(t)  — •dc2'c(t)  d"  Bcy{t),  (^•3) 

u{t)  =CcXcii),  (6.4) 

that  satisfies  the  following  design  criteria: 

i)  the  closed-loop  system  (6.1)-(6.4)  is  asymptotically  stable  for  all  Ai4  G  It;  and 


ii)  the  performance  functional  (5.4)  with  J{K)  replaced  by  J{Ac,Bc,Cc)  is  minimized. 
For  each  uncertain  variation  A  A  G  U,  the  closed-loop  system  (6.1)-(6.4)  can  be  written  as 


i(<)  =  (A -f  AA)i(t) -f- jDio(t),  t  >  0, 


(6.6) 


where 


x(0  = 


x{t) 

Xc(0j 


A  BCc 
BcC  Aj 


,  AA  = 


A  A  0,1  xn^ 

On*  xn  tlric  J  * 


and  where  the  closed-loop  disturbance  D'w{t)  has  intensity 

V  =  DD^, 


■  Di  ■ 

V  = 

5  K  — 

where  D  = 
uncertainty  AA  has  the  form 

where 


Vi  0 

0  BcV^Bj 


Bo  = 


Bo 

[On^  Xmo  J 


,Vi  =  DiDJ,V2  =  D2DJ.  The  closed-loop  system 

AA  =  BqFCo  (6*fi) 

)  Go  =  [Go  OmoXTic]" 
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Finally,  if  A +  AA  is  asymptotically  stable  for  all  A  A  €  If  for  a  given  compensator  (Ac,ilc>C’c)> 
tlien  the  performance  measure  (5.4)  is  given  by 

J{Ac,Bc,Cc)=  sup  (6.7) 

Ai4€U 

where  satisfies  the  2n  x  2n  algebraic  Lyapunov  equation 

0  =  (A  +  AAfP^^  +  P^^(A  +  AA)  +  ft,  (6.8) 

where 

E=[E,  /i  =  £T£=[^;  . 

Next,  we  proceed  as  in  Section  5  where  we  replace  the  Lyapunov  equation  (6.8)  for  the  dy¬ 
namic  problem  with  a  Iliccati  equation  that  guarantees  that  the  closed-loop  system  is  robustly 
stable.  Thus  for  the  dynamic  output  feedback  problem.  Theorem  4.1  holds  with  A,R,V  replaced 
by  A,  ft,  V. 

For  convenience  in  stating  the  main  result  of  tliis  section,  recall  the  definitions  of  Ro,R2a,Pa 
and  define  the  additional  notation 

E  =  C'^Vf^C, 

Aq  =  A- QS  +  BoRo^NCo{A  -f  BqMiCq)  -h  i?oPo'*^o  ^  +  BoRq^Co  +  BqMiCo, 
for  arbitrary  Q,  P  £ 

Theorem  6.1.  Assume  ilo  >  0  and  assume  T  and  N  are  strongly  compatible.  Furthermore, 
suppose  there  exist  n  x  n  nonnegative-definite  matrices  P,Q,P  satisfying 

0  =[A  -f  BqMiCq  -1-  BoR^^Co  +  BoR^^NCo{A  +  BoMiCo)]'^P 

+  P[A  -I-  BqMiCo  -b  BoRq^Co  +  BoR^^NCo{A  +  BqMiCo)]  +  Ri 
-b  [Co  -b  NCo{A  -b  BoMiCo)fR^^[Co  +  NCo{A  +  BqMiCo)] 

+  PBoRo^BjP-PfR^^P„  (6.9) 

0  =[A  -b  BqMiCo  +  BqRq^bJ{P  -b  P)  -b  BqRq^NCq{A  -b  BqMiCq)]Q  (6.10) 

-b  Q[A  -b  BqMiCo  -b  BoRo^bJ{P  -b  P)  +  BqR^^NCq{A  -b  BqMxCq)]^  PVi-  QSQ, 

0  =A5P  -b  PAq  +  PBqR-^B'^P  +  PjR^^Pa,  (6.11) 
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and  let  Ac,  Be,  Cc  be  given  by 

Ac  =A-Qt-  BR^lPc  -  BoRo'NCoBR^^Pc 

+  BqRq^ N Co{A  +  BqMiCo)  +  BqRq^Cq  +  BqMiCq  +  BqRq^ Bq  P,  (6.12) 
Be  =QC^V2-\  (6.13) 

Cc  =  -  R^^Pa-  (6.14) 

Then  (^4  +  A  A,  E)  is  detectable  for  all  A  A  G  U  if  and  only  if  A  +  A  A  is  asymptotically  stable  for 
aU  AA  €  It.  In  this  case,  the  performance  of  the  closed-loop  system  (6.5)  satisfied  the  bound 

J{Ac,Bc,Cc)  <  tr((P  -1-  P)Vi  +PQSQ-{-  CjfiCoVi]  (6.15) 

Proof.  The  proof  follows  as  in  the  proof  given  in  [7].  □ 

Remark  6.1  Note  that  if  the  uncertainty  in  the  plant  dynamics  is  deleted,  that  is,  Bq  = 
0,  Co  =  0,  then  Theorem  6.1  specializes  to  the  standard  LQG  result. 
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G  =  (I+GMi)  ^G,  A  =  A-Mi. 

Figure  4- 
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Letters 


Robust  Stability  Analysis  Using  the  Small  Gain,  Circle, 
Positivity,  and  Popov  Theorems:  A  Comparative  Study 

Wassim  M.  Haddad.  Emmanuel  G. 

Collins,  jr.,  and  Dennis  S.  Bernstein 


Abstract — This  note  analyzes  the  stability  robustness  of  a  Maximum 
Entropy  controller  designed  for  a  benchmark  problem.  Four  robustness 
tests  are  used:  small  gain  analysis,  circle  analysis,  positive  real  analysis, 
and  Popov  analysis,  each  of  which  is  guaranteed  to  give  a  less  conservative 
result  than  the  previous  test.  The  analysis  here  is  performed  graphically 
although  recent  research  has  developed  equivalent  tests  based  on  Lya¬ 
punov  theory.  The  Popov  test  is  seen,  for  this  example,  to  yield  highly 
nonconservative  robust  stability  bounds.  The  results  here  illuminate  the 
conservatism  of  analysis  based  on  traditional  small-gain  type  tests  and 
reveal  the  effectiveness  of  analysis  tests  based  on  Popov  analysis  and 
related  parameter-dependent  Lyapunov  functions. 


1.  INTRODUCTION 

In  control  engineering  practice,  control  design  (whether  classical 
or  modem)  is  usually  predicated  upon  some  nominal  (usually  linear) 
model  of  the  plant  to  be  controlled.  However,  this  nominal  model 
of  the  system  is  never  an  exact  representation  of  the  true  physical 
system.  This  necessitates  tools  that  allow  a  control  system  to  be 
analyzed  for  robustness  with  respect  to  errors  in  the  design  model. 
These  analysis  tools  almost  always  lead  to  techniques  for  actually 
designing  a  control  system  for  robustness. 

In  classical  control,  gain  and  phase  margins  are  often  used  as 
indirect  measures  of  robustness.  However,  these  criteria  do  not 
alw'ays  adequately  provide  robustness  with  respect  to  the  true  plant 
uncertainties.  Hence,  to  add  reliability  to  the  analysis  process,  more 
direct  and  rigorous  measures  of  robustness  are  needed.  To  guarantee 
the  best  performance  possible,  in  the  presence  of  uncertainties  in 
the  system  model,  it  is  important  that  these  robustness  measures  be 
nonconservative. 

In  the  analysis  of  systems  for  robustness,  the  conservatism  of  the 
resulting  robust  stability  and  performance  bounds  is  largely  dependent 
upon  the  characterization  of  the  uncertainly  in  the  analysis  process. 
This  uncertainty  characterization  can  be  viewed  as  lying  between 
two  extremes.  In  the  state  space,  one  extreme  would  be  to  model  the 
uncertainty  as  constant,  real  parameters  while  the  opposite  extreme 
would  be  to  model  the  uncertainty  as  arbitrarily  time-varying,  real 
parameters.  In  the  frequency  domain,  the  corresponding  extremes  are 
to  model  the  uncertainty  as  a  transfer  function  with  bounded  phase 
or  oppositely,  as  a  transfer  function  with  arbitrary  phase. 

If  the  uncertainty  is  truly  constant  and  real,  then  modeling  it  as 
arbitrarily  time-varying  can  lead  to  very’  conservative  results.  For 
example,  classical  analysis  of  a  Hill’s  equation  (e.g.^  the  Mathieu 
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Fig.  1  Standard  uncertainty  representation. 


equation)  shows  that  lime-varying  parameter  variations  can  desta¬ 
bilize  a  system  even  when  the  parameter  variations  are  confined 
to  a  region  in  which  constant  variations  are  nondestabilizing  (1). 
Also,  as  seen  in  [2]  which  analyzes  stiffness  uncertainty  for  a 
flexible  structure,  when  uncertainty  is  modeled  as  having  arbitrary 
phase,  predictions  for  stability  and  performance  will  be  much  more 
conservative  than  results  developed  assuming  phase-bounded  (e.g., 
positive  real)  uncertainty. 

In  recent  years  it  has  become  conventional  to  model  plant  uncer¬ 
tainty,  say  AA',  using  the  feedback  configuration  shown  in  Figure 
1.  In  this  figure  G(s)  denotes  the  nominal  plant.  Four  of  the  most 
fundamental  results  concerning  stability  of  feedback  system  intercon¬ 
nections  are  the  small  gain,  circle,  positivity,  and  Popov  theorems 
[1,  3].  Even  though  these  theorems  were  originally  developed  to 
analyze  stability  of  system  with  a  single,  memoryless  nonlinear 
element  in  a  feedback  configuration  [1],  in  recent  research  13.  4] 
each  result  was  reinterpreted  and  generalized  to  the  problem  of  robust 
stability  involving  linear  uncertainty.  To  do  this,  a  Lyapunov  function 
framework  was  established,  providing  connections  of  these  classical 
results  to  robust  stability  and  performance  via  state  space  methods. 

As  shown  in  [3],  the  main  difference  between  the  small  gain, 
circle,  and  positivity  theorems  versus  the  Popo\-  theorem  is  that 
the  former  results  guarantee  robustness  with  respect  to  arbitrarily, 
lime-varying  uncertainty  while  the  Popov  theorem  restricts  the  time 
variation  of  the  uncertainty.  This  is  not  surprising  once  one  recognizes 
that  the  Lyapunov  function  foundation  of  the  small  gain,  circle, 
and  positivity  theorems  is  based  upon  conventional  or  “fixed" 
quadratic  Lyapunov  functions  which,  of  course,  guarantee  siabilit)' 
with  respect  to  arbitrarily,  time-varying  perturbations.  In  contrast,  the 
Popov  theorem  is  based  upon  a  quadratic  Lyapunov  function  that  is  a 
function  of  the  parametric  uncertainly,  that  is,  a  parameter-dependent 
quadratic  Lyapunov  function  [3,  4],  Hence,  in  effect,  the  Popov  result 
guarantees  stability  by  means  of  a  family  of  Lyapunov  functions.  A 
key  aspect  of  this  approach  [4]  is  the  fact  that  it  does  not  apply  to 
arbitrarily  time-varying  uncenainties,  which  renders  it  significantly 
less  consenaiive  than  fixed  quadratic  Lyapunov  functions  in  the 
presence  of  constant  real  parameter  uncertainty. 

To  illuminate  the  conservatism  of  robustness  analysis  based  on 
traditional  small-gain  type  tests  for  constant  real  parameter  un¬ 
certainty  and  to  reveal  the  importance  of  tests  which  restrict  the 
time-variation  in  the  state  space  and  thus  allow  the  incorporation 
of  phase  information  in  the  frequency  domain,  we  consider  a  simple 
tw’o-mass/spring.  lightly  damped,  system  with  uncenain  stiffness  [5]. 
This  example  was  chosen  to  highlight  the  inherent  drawbacks  of 
small  gain  principles  applied  to  the  analysis  of  feedback  systems  with 
constant  real  parameter  uncenainty.  A  quadratic  Lyapunov  function 
framework  leading  to  an  algebraic  basis  in  terms  of  matrix  Riccati 
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Fig.  2  Spring-mass  system. 


equations  for  the  analysis  and  synthesis  of  robust  controllers  for  the 
small-gain,  circle,  positivity,  and  Popov  theorems  is  given  in  [3,  4]. 
Nevertheless,  for  simplicity  the  analysis  presented  here  is  graphical. 


IL  Two-mass/spring  example 

Consider  the  two-mass/spring  system  shown  in  Figure  2  with 
uncertain  stiffness  k.  A  control  force  acts  on  body  1,  and  the 
position  of  body  2  is  measured  resulting  in  a  noncolocated  control 
problem.  Here,  we  consider  Controller  \#1  of  [6,  7]  which  was 
designed  for  Problem  \#  1  of  a  benchmark  problem  [5]  using  the 
Maximum  Entropy  robust  control  design  technique.  The  controller 
transfer  function  given  by 

194390(s  +  0.33679)[(s  -  0.11735)^  +  0.90996^] 

“  (s  +  81.438)(s  +  131.04)[(s+  2.9049)2  4. 1.86I52] 

was  designed  so  that  the  closed-loop  system  is  robust  with  respect  to 
perturbations  in  the  nominal  value  of  the  stiffness  k  (i.e.,  k  ~  k„om)> 
The  exact  stiffness  stability  region  over  which  the  system  will  remain 
stable  was  computed  by  a  simple  search  and  is  given  by 

0.4459  <k<  2.0660.  (2) 

Next,  using  a  graphical  approach  we  apply  small  gain  analysis,  circle 
analysis,  positive  real  analysis,  and  Popov  analysis  to  determine  the 
stiffness  stability  regions  predicted  by  each  of  these  tests.  Each  of 
these  tests  is  related  to  the  previous  test  and  is  guaranteed  to  be  less 
conservative. 

We  begin  by  constructing  the  uncertainty  feedback  system  that  will 
be  used  in  each  of  the  tests.  The  plant  (for  mi  =  mg  =  1)  is  given 
by  the  triple  (A(k),  B,C)  where 


SMALL  GAIN  ANALYSIS 


Real  Axis 

Fig.  3  Small  gain  analysis. 

Next,  define  Bq  =  [.bJ  Oix^].  Co  —  [Co  Oix-i]  and  let 
(7(s)  =  -CoisI  -  A{knom))~^ Bq.  Then,  the  plant  uncertainty  Ak 
can  be  represented  by  a  fictitious  feedback  loop  as  shown  in  Figure  1 . 

For  each  of  the  tests  below  we  will  determine  Ak  (positive)  and 
Ak  (negative)  such  that  stability  is  guaranteed  for 

kuom  A^<k<  knom  +  3jf.  (6) 


Small  Gain  Analysis 

Small  gain  analysis  requires  considering  the  Nyquist  diagram  of 
G{s),  The  smallest  circle  centered  at  the  origin  that  completely 
encompasses  the  Nyquist  diagram,  Im[G{juj)]  vs.  Re[G(ju;)]  for  all 
u;,  (without  touching  it)  is  then  drawn.  The  intersection  of  this  circle 
with  the  negative  real  axis  is  given  by  and  the  intersection 

with  the  positive  real  axis  is  given  by  —  1/AA’.  This  analysis  is  shown 
in  Figure  3.  It  follows  that  :\k  =  0.1496  and  =  —0.1496.  Hence, 
using  small  gain  analysis,  stability  is  guaranteed  for 

0.4504  <k<  0.7496.  (7) 


A{k)  = 


0  0 
0  0 
-fc  k 
k  -k 


1  0" 

0  1 
0  0  ’ 
0  0 


C  =  [0  1  0  0].  (3) 


The  perturbation  m  A(k)  due  to  a  change  in  the  stiffness  element  k 
from  nominal  value  knom  is  given  by 


A(k)  -  .4(fc„om)  =  A/4  =  BoAfcCo  (4) 


where  BJ  =  [0  0  -  1  1]  and  Co  =  [1  -  1  0  0].  In  the  subsequent 
analysis  we  will  choose  Anom  =  0.6  since  the  controller  (1)  was 
developed  under  this  assumption. 

Let  the  triple  (Ac,  B^  Cc)  denote  the  state  space  representation  of 
the  controller  (1).  Then,  assuming  negative  feedback,  the  closed- loop 
state  matrix  is  given  by 


A{k)^ 


'A{k) 

BCc 


--BCc' 
Ac  / 


Note  that  since  the  AA  uncertainty  block  is  comprised  of  a  single 
scalar,  this  result  is  equivalent  to  a  //-analysis  lest  [8]. 

Circle  Analysis 

As  in  small  gain  analysis,  circle  analysis  determines  stability 
bounds  by  drawing  a  circle  that  completely  encompasses  the  Nyquist 
diagram  (without  touching  it).  However,  the  circle  criterion  allows 
the  center  of  the  circle  to  lie  anywhere  along  the  real  axis  and  can 
hence  give  a  less  conservative  bound  A  A  (or  AA)  at  the  expense  of 
increased  conservatism  in  the  remaining  bound  AA  (or  AA).  Here 
we  choose  the  center  of  the  circle  to  lie  at  ((  •Tmin  4"  J^max  )/2.0) 
where  Xmin  is  the  minimum  real  part  of  the  Nyquist  diagram  and 
Xmax  is  the  maximum  real  part.  The  intersection  of  this  circle  with 
the  negative  real  axis  equals  —  1/AA  and  the  intersection  with  the 
positive  real  axis  equals  by  -1/AA.  This  analysis  is  shown  in  Figure 
4,  It  follows  that  AA  =  0.3167  and  Ak  —  —0.1277.  Hence,  using 
circle  analysis,  stability  is  guaranteed  for 


(5) 


0.4722  <  A  <  0.9167. 


(8) 
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RcalAxis  RcalAxis 

Fig.  4  Circle  analysis.  Fig.  5  Positive  real  analysis. 


Positive  Real  Analysis 

Positive  real  analysis  determines  stability  bounds  by  drawing 
straight-lines  that  lie  to  the  left  or  right  of  the  Nyquist  diagram 
(without  touching  it).  It  is  equivalent  to  the  limit  of  the  circle  criterion 
as  the  center  of  the  circle  moves  toward  infinity  along  the  positive 
or  negative  real  axis  and  will  always  give  less  conservative  bounds. 
For  the  Nyquist  diagram  of  G{s),  the  intersection  of  the  line  to  the 
left  of  the  Nyquist  plot  with  the  negative  real  axis  equals  —1/Ak. 
The  intersection  of  the  line  to  the  right  of  the  Nyquist  plot  with  the 
positive  real  axis  equals  —l/A/c.  This  analysis  is  shown  in  Figure 
5.  It  follows  that  Ak  =  0.5277  and  =  '-0.1522.  Hence,  using 
positive  real  analysis,  stability  is  guaranteed  for 

0.4478  <k  <  1.1277.  (9) 


Popov  Analysis 

Popov  analysis  is  a  test  that  determines  a  stability  bound  from  a 
modified  Nyquist  diagram,  namely  the  Popov  plot.  u)Im[G{ju})]  vs. 
RelGiju:)]  for  >  0.  This  analysis  requires  finding  lines  (Popov 
lines)  that  intersect  the  negative  or  positive  real  axis  at  a  point  that 
is  to  the  left  of  the  Popov  plot  but  as  close  to  the  origin  as  possible. 
The  slope  of  these  lines  are  -l/.V  and  -l/K  where  N  and  iV  are 
the  Popov  multipliers.  The  Popov  test  is  equivalent  to  the  positive 
real  lest  if  the  lines  are  chosen  to  be  vertical.  For  the  Popov  diagram 
of  (5(s),  the  intersection  of  the  line  to  the  left  of  the  Popov  plot  with 
the  negative  real  axis  equals  —\/Ak.  The  intersection  of  the  line  to 
the  right  of  the  Popov  plot  with  the  positive  real  axis  equals  —  l/Ak. 
This  analysis  is  shown  in  Figure  6.  It  follows  that  Ak  =  1.4660 
and  ^  =  0.1541  and  the  corresponding  Popov  multipliers  are 
respectively  .V  =  0.7999  and  =  —0.2755.  Hence,  using  Popov 
analysis,  stability  is  guaranteed  for 

0.4459  <k<  2.0660.  (10) 

Note  that  these  bounds  are  identical  to  the  exact  bounds  (2),  at 
least  to  four-digit  precision  for  the  lower  bound  and  five  digit 
precision  for  the  upper  bound.  Hence,  for  this  example,  Popov 
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Rea)  Axis 

Fig.  6  Popov  analysis. 


analysis  yielded  highly  nonconservative  results.  This  is  not  surprising 
since,  as  mentioned  in  the  Introduction,  the  Popov  result  is  based  upon 
a  parameter-dependent  Lyapunov  function  which  severely  restricts  the 
allowable  time  variation  of  the  uncertain  parameters  and  hence  closely 
approximates  real  parameter  uncertainty  within  robustness  analysis. 


III.  Conclusion 

We  have  shown  by  means  of  a  simple  iwo-mass/spring  example 
with  uncertain  stiffness  that  small  gain  modeling  of  constant  real 
parameter  uncertainty  can  be  extremely  conserv'aiive.  An  alternative 
approach  to  the  phase  informaiion/real  parameter  uncertainly  problem 
using  Popov  analysis  and  related  parameter-dependent  Lyapunov 
functions  was  shown  to  be  significantly  less  conserx’ative.  Although 
Popov  analysis  was  traditionally  developed  to  analyze  stability  of  a 
system  with  a  single,  memoryless  nonlinear  element  in  a  feedback 
configuration,  recent  results  have  reinterpreted  Popov  analysis  to 
handle  the  problem  of  robust  stability  involving  constant,  linear 
uncertainty  [3,  4]. 
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The  results  here  demonstrate  the  somewhat  overlooked  fact  that 
Popov  analysis  can  be  very  nonconservative  when  applied  to  the 
analysis  of  linear  systems  with  linear  uncertainty. 

Finally,  it  should  be  acknowledged  that  the  results  of  [3,  4] 
allow  Popov  analysis  to  be  used  to  synthesize  robust  controllers. 
This  problem  of  robust  control  can,  of  course,  be  alternatively 
approached  using  adaptive  control  techniques  [9,  10]  which  implicitly 
or  explicitly  identify  the  model  uncertainty.  It  is  possible  that  the 
results  discussed  in  [3,  4]  can  be  used  as  a  basis  for  using  Popov 
analysis  to  determine  the  stability  and  robustness  properties  of 
adaptive  controllers. 
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In  recent  years,  small  gain  (or  //»)  analysis  has  been  used  to  analyze  feedback  systems  for  robust  stability  and 
performance.  However,  since  small  gain  analysis  allows  uncertainty  with  arbilraiy  phase  in  the  frequency 
domain  and  arbitrary  time  variations  in  the  time  domain,  it  can  be  overly  conservative  for  constant  real 
parametric  uncertainly.  More  recent  results  have  led  to  the  development  of  robustness  analysis  tools,  such  as 
extensions  of  Popov  analysis,  that  are  less  conservative.  These  tests  are  based  on  parameter-dependent  Lya¬ 
punov  functions,  in  contrast  to  the  small  gain  test,  which  is  based  on  a  fixed  quadratic  Lyapunov  function.  This 
paper  uses  a  benchmark  problem  to  compare  Popov  analysis  with  small  gain  analysis  and  positivity  analysis  (a 
special  case  of  Popov  analysis  that  corresponds  to  a  fixed  quadratic  Lyapunov  function).  The  state-space 
versions  of  these  tests,  based  on  Riccatf  equations,  are  implemented  using  continuation  algorithms.  The  results 
show  that  the  Popov  test  is  significantly  less  conservative  than  the  other  two  tests  and  for  this  example  is 
completely  nonconservative  in  terms  of  its  prediction  of  robust  stability. 


I.  Introduction 

NE  of  the  most  important  aspects  of  the  control  design 
and  evaluation  process  is  the  analysis  of  feedback  sys¬ 
tems  for  robust  stability  and  performance.  Over  the  past  sev¬ 
eral  years,  significant  attention  has  been  devoted  to  the  use  of 
small  gain  (or  //«)  tests  for  robustness  analysis. However,  it 
is  well  known  that  these  tests  can  be  very  conservative  since  in 
the  frequency  domain  the  small  gain  test  characterizes  uncer¬ 
tainty  with  bounded  gain  but  arbitrary  phase,  whereas  in  the 
time  domain  the  small  gain  test  characterizes  uncertainty  with 
arbitrary  time  variation.^  This  conservatism  has  led  to  the 
search  for  more  accurate  robustness  tests.  In  particular,  re¬ 
searchers  have  searched  for  tests  that  allow  frequency  domain 
uncertainty  characterization  to  include  phase  bounding  or 
time  domain  uncertainly  characterization  to  include  restric¬ 
tions  on  the  allow'able  time  variations. 

The  small  gain  test  is  actually  based  on  conventional  or 
“fixed”  quadratic  Lyapunov  functions  that  guarantee  stabil¬ 
ity  with  respect  to  arbitrarily  time-varying  perturbations.  Very 
recently,  however,  robustness  tests  have  been  developed  that 
are  based  on  quadratic  Lyapunov  functions  that  are  a  function 
of  the  parametric  uncertainty,  that  is,  “parameter-dependent 
Lyapunov  functions. In  contrast  to  analysis  based  on  a 
fixed  quadratic  Lyapunov  function,  these  tests  guarantee  ro¬ 
bust  stability  by  means  of  a  family  of  Lyapunov  functions  and 
do  not  apply  to  arbitrarily  time-varying  uncertainties.  Hence, 
when  the  actual  uncertainty  is  real  and  constant,  these  tests  are 
less  conservative  than  tests  based  on  fixed  quadratic  Lyapunov 
functions.^ 

In  this  paper  we  use  a  benchmark  problem  to  compare  the 
Popov  test,^  based  on  a  parameter-dependent  Lyapunov  func- 
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tion,^’"^  with  the  small  gain^  and  positivity  tests^  that  are  based 
on  fixed  quadratic  Lyapunov  functions.^*’  Each  of  the  stabil¬ 
ity  tests  has  graphical  interpretations  for  the  case  of  one- 
block,  scalar  uncertainty.^  However,  here  we  will  emphasize 
the  state-space  tests  that  are  based  on  Riccati  equations  and 
allow  the  development  of  robust  H2  performance  bounds  in 
addition  to  the  determination  of  robust  stability.  We  develop 
continuation  algorithms  for  the  special  case  of  one-block, 
scalar  uncertainty.  The  algorithm  for  Popov  analysis  addition¬ 
ally  requires  that  a  certain  product  (Co^o)  related  to  the  uncer¬ 
tainty  characterization  be  equal  to  zero.  As  will  be  seen  in  Sec. 
Ill,  this  condition  holds  for  the  parametric  uncertainty  under 
consideration.  The  algorithms  are  applied  to  analyze  a  feed¬ 
back  system  for  the  benchmark  system  in  which  the  controller 
was  designed  using  the  maximum  entropy  approach.® 

The  paper  is  organized  as  follows.  Section  II  presents  the 
linear  system  to  be  analyzed  for  robust  stability  and  perfor¬ 
mance  and  gives  the  main  theorems  for  the  small  gain,  positiv¬ 
ity,  and  Popov  tests.  Section  III  then  considers  the  benchmark 
problem  and  formulates  the  feedback  system  to  be  analyzed  in 
the  format  of  Sec.  II.  Section  IV  applies  the  graphical  tests  to 
determine  robust  stability.  Next,  Sec.  V  develops  continuation 
algorithms  for  a  special  case  of  the  state-space  tests  and  ap¬ 
plies  the  algorithms  to  the  benchmark  problem.  Finally,  Sec. 
VI  discusses  the  conclusions  and  directions  for  future  work. 


II.  Riccati  Equation  Characterizations  for  the  Small 
Gain,  Positivity,  and  Popov  Theorems 
We  begin  this  section  by  establishing  some  basic  notation 
and  definitions.  Let  (R  denote  the  real  numbers,  and  let  ( • )  ^ 
and  ( •  )*  denote  transpose  and  complex  conjugate  transpose. 
Furthermore,  we  write  tl  -*112  for  the  Euclidean  norm,  II  •  11^  for 
the  Frobenius  norm,  • )  ^or  the  maximum  singular  value, 
tr( » )  for  the  trace  operator,  and  M  >  0  (Af  >0)  to  denote  the 
fact  that  the  hermitian  matrix  M  is  nonnegative  (positive) 
definite.  The  notation 


'a 

b' 

_c 
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denotes  that  C(s)  is  a  transfer  function  corresponding  to  the 
state-space  realization  {A,  B,  C,  D),  i.e..  G(5)  =  C(sl  -  A)~^ 
X  B  +  D,  The  notation  is  used  to  denote  a  minimal 

realization.  For  asymptotically  stable  G(5),  define  the  Hi  and 
Ha,  norms,  respectively,  where  cj  €  [0,  oo),  as 

|IC(j)ll5  ^  I  IIC(/a))ll?-  dcj  (2a) 

27r  J  ^  on 

\\G{s)\\„^a^^(GU^))  {2b) 

A  transfer  function  G(j)  is  bounded  real  if  1)  G(5)  is 
asymptotically  stable  and  2)  IIG(/cij)ll«  <  1  for  cj  6  [0,oo). 
Furthermore,  G(5)  is  called  strictly  bounded  real  if  1)  G(5)  is 
asymptotically  stable  and  2)  IIG(/aj)IIoD<  1  for  cj  €  [0,oo).  Fi¬ 
nally,  note  that  if  G(5)  is  strictly  bounded  real,  then 
/  -  D^D>0,  where  D  =  G(oo). 

A  square  transfer  function  G(5)  is  called  positive  real  if  1) 
all  poles  of  G(s)  are  in  the  closed  left  half-plane  and  2) 
G(/aj) -K  G*(/tj)  is  nonnegative  definite  for  cj  €  [0,oo).  A 
square  transfer  function  G(s)  is  called  strictly  positive  real  if 
1)  G{s)  is  asymptotically  stable  and  2)  G(/cj)  +  G*(/cj)  is 
positive  definite  for  cj  €  (0,oo).  Finally,  a  square  transfer 
function  G(j)  is  strongly  positive  real  if  it  is  strictly  positive 
real  and  D  +  £)^>0,  where  D  =  G(oo).  (Note  that  in  some  of 
the  literature  * ‘strongly  positive  real**  as  defined  here  is  re¬ 
ferred  to  as  “strictly  positive  real.“) 

At  this  point,  we  consider  a  linear  uncertain  system  of  the 
form 

m  =  {A  -  BoFCo)x(t)  +  i5w(r),  m  €  (3) 

z(t)  =  Ex{t)  (4) 

Note  that  the  system  (3)  and  (4)  may  denote  a  linear  feedback 
system  subject  to  an  exogeneous  disturbance  signal  w{t).  The 
individual  elements  of  z(t)  may  denote  the  performance  vari¬ 
ables,  possibly  including  the  actuation  signals.  The  product 
-  BqFCo  then  denotes  the  parametric  uncertainty  (i.e.,  j\A). 
In  particular,  Bq  and  Q  are  fixed  matrices  denoting  the  struc¬ 
ture  of  the  uncertainty  and  F  is  an  uncertain  matrix.  Here,  it 
is  assumed  that  for  some  nonnegative  definite  diagonal  matrix 
M,  F  €  FCi  .  or  for  some  nonnegative  scalar  7,  F  €  where 

=  |F€  CR"™'''"": /"is  diagonal,  0£F< A/)  (5) 


Fig.  I  Feedback  system  to  be  analyzed  for  robust  stability. 


0={A-§^CoVP  +  P(A-BoFCo)  +  R  (12) 

0  =  iA-  BoFCo)Q  +^(A-  BoFCof  +V  (13) 

If  w{t)  is  a  standard  white  noise  process  with  identity  inten¬ 
sity,  then  J{F)  =  lim,^*  £[x^(/)^;c(/)].  Later  we  will  present 
robust  performance  bounds  J such  that  J(F)  :<  J  for  each  Fin 
the  uncertainty  set. 

Next,  we  state  the  versions  of  the  small  gain,  positivity,  and 
Popov  theorems  that  give  sufficient  conditions  for  the  stability 
of  the  uncertain  system  (3)  or,  equivalently,  the  negative  feed¬ 
back  interconnection  of  Fig.  1.  Each  of  the  theorems  includes 
both  a  frequency  domain  test  and  an  equivalent  state-space 
test.  In  addition,  robust  Hi  performance  bounds  correspond¬ 
ing  to  the  state-space  tests  are  presented. 

Theorem  1  (Small  Gain  Theorem^),  If  (l/7)G(.s)  is  strictly 
bounded  real,  then  the  negative  feedback  interconnection  of 
C(5)  and  F  is  asymptotically  stable  for  all  F  €  F^.  Equiva¬ 
lently,  if  for  any  symmetric,  positive  definite  R  there  exists  a 
positive  scalar  a.  and  nonnegative  definite  P  satisfying 

(i  =  A'^P  +  PA+y- ^PBoBqP  +  ClCo  +  aR  (14) 

then  the  uncertain  system  (3)  is  asymptotically  stable  for  all  F 
€  Fy.  In  this  case,  for  all  F  €  Fy, 

/(F)<  J(a)-  (l/a)tr(FV)  (15) 

Theorem  2  (Positivity  Theorem^).  If  A/  “  *  +  G(5)  is  strongly 
positive  real,  then  the  negative  feedback  interconnection  of 
G(5)  and  Fis  asymptotically  stable  for  all  F  €  F^.  Equiva¬ 
lently,  if  for  any  symmetric,  positive  definite  R  there  exists  a 
positive  scalar  a  and  nonnegative  definite  P  satisfying 

0  =  A'^P  +  PA  +  ViiCo  -  B^PYM  -  ‘(Co  -  ^^^P)  +  aR  (16) 


Fy=  (F  6  (R"*®  ^ F  is  diagonal,  F^  <  7 ~  )  (6) 

If  we  additionally  define 

Fv^  =  (F€  Fis  diagonal,  -A/<F<01  (7) 

then  F  €  F^  if  and  only  if  -  F  €  F^ ,  and  if  7  "  ‘  =  <rmax(^^)» 
F  €  Fy  implies  F  €  F4J  UFv/  • 

Now,  denote  C}(s)  by 


'  A 

h 

[Co 

0. 

Then  evaluation  of  the  robust  stability  of  Eq.  (3)  is  equivalent 
to  evaluation  of  the  robust  stability  of  the  feedback  system 
shown  in  Fig.  1. 

It  now  follows  that  for  asymptotically  stable  A  -  BqFCo  the 


Hi  norm  for  Eqs.  (3)  and  (4)  is  given  by 

J(F)  =  trQR=  tr 

(9) 

where 

R 

(10) 

9  =  DD^ 

(11) 

then  the  uncertain  system  (3)  is  asymptotically  stable  for  all  F 
6  F^ .  In  this  case,  for  all  F  €  F^  , 

y(F)  <  J(a)  =  (l/a)tr(FK)  (17) 

Theorem  3  (Popov  Theorem^^^),  If  there  exists  a  non-neg- 
ative-definite  diagonal  matrix  N  such  that  A/"‘  + 
(/  +  Ns)G(s)  is  strongly  positive  real,  then  the  negative  feed¬ 
back  interconnection  of  G(j)  and  F  is  asymptotically  stable 
for  all  F  €  F^  .  Equivalently,  if  for  any  symmetric,  positive 
definite  R  there  exists  a  nonnegative-definite  diagonal  matrix 
N,  a  positive  scalar  a  and  nonnegative-definite  P  satisfying 

0  =  A^P+PA+{Co  +  NCoA  -  bIpV[(M  "  '  +  NCoBo) 

+  (Af  -  '  +  NCoBo)^  -  '(Co  +  NCoA  -  BjP)  +  aR  (18) 

then  the  uncertain  system  (3)  is  asymptotically  stable  for  all  F 
6  F^  .  In  this  case,  for  all  F  €  F^  , 

J(F)  S  J(a,  N)  =  (l/a)tr((P  +  C^MNCq)  ^0  (19) 

Remark  1.  Theorem  2  may  be  considered  a  special  case  of 
Theorem  3  with  N  -0. 

Remark  2.  In  each  of  the  three  theorems  the  requirement 
that  R  be  positive  definite  can  be  relaxed.  In  particular,  R  is 
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allowed  to  be  nonnegative  definjte  as  long  as  the  pair  (A,  £)  is 
detectable  where  £  satisfies  £^£  =  R. 

Remark  3.  For  the  case  of  scalar  uncertainly  F  (i.e., 
/no=  1),  the  frequency  domain  tests  given  in  the  three  theo¬ 
rems  have  easy-to-implement  graphical  frequency  domain  in¬ 
terpretations.^ 

Remark  4,  As  shown  in  Ref.  7,  the  Lyapunov  function 
that  establishes  robust  stability  of  the  negative  feedback  inter¬ 
connection  of  G{s)  and  F  in  Theorems  1  and  2  is  a  fixed 
Lyapunov  function  of  the  form  V(x)  =  x^Px  where  P  satisfies 
Eqs,  (14)  and  (16),  respectively.  On  the  other  hand,  the  Lya¬ 
punov  function  that  establishes  robust  stability  of  the  negative 
feedback  interconnection  of  G(.y)  and  F  in  Theorem  3  is  a 
parameter-dependent  Lyapunov  function;  that  is,  it  is  a  func¬ 
tion  of  the  uncertain  parameters  and  has  the  form 
V(x)  =  x^Px  4-  x'^CqFNCqX  where  P  satisfies  Eq.  (18). 

Remark  5.  Note  that  the  Popov  multiplier  N  can  be  a 
negative-definite  diagonal  matrix  that  in  the  single-input/sin¬ 
gle-output  (SISO)  case  simply  corresponds  to  a  Popov  line  in 
the  Popov  plane  with  a  negative  slope.-  In  this  case,  we  note 
that  the  candidate  Lyapunov  function  has  the  form  V(x)  = 
x^^Px  -  x’^CqFNCoX,  where  jV>0.  Hence,  it  is  necessary  to 
check  a  posteriori  the  positive  definiteness  of  V(x)  for  all  F  6 
Fm  to  insure  that  V(x)  is  a  Lyapunov  function. 

Remark  6.  An  alternative  statement  of  Theorem  3  that 
directly  captures  uncertainty  F  €  UF^  can  be  obtained  by 
considering  the  multivariable  shifted  Popov  theorem.^  Specif¬ 
ically,  this  case  corresponds  to  replacing  M  with  2M  and  A 
with  A  -  BqMCq  in  Theorem  3.  In  this  case  the  frequency 
domain  interpretation  for  the  case  of  scalar  uncertainty  in¬ 
volves  a  family  of  frequency-dependent  off-axis  circles  in  the 
Nyquist  plane.  The  circle  centers  vary  as  a  function  of  the 
phase  of  the  Popov  multiplier,  but  each  has  the  same  real  axis 
intercepts  at  For  further  details  see  Refs.  9-11. 


III.  Benchmark  Two-Mass/Spring  Example 

Consider  the  two-mass/spring  system  shown  in  Fig.  2  with 
uncertain  stiffness  k.  A  control  force  acts  on  body  1,  and  the 
position  of  body  2  is  measured,  resulting  in  a  noncollocated 
control  problem.  Here,  we  consider  controller  1  of  Ref.  8, 
which  was  designed  for  problem  1  of  a  benchmark  problem’^ 
using  the  maximum  entropy  robust  control  design  technique. 
The  controller  transfer  function  given  by 

^  194390(5  4-  0.33679)[(j  -  0.11735)^  +  0.90996^] 
"^'^^"(5-^  81.438)(5  -h  13 1.04)1(5  +  2.9049)2+  1.86152] 


Fig.  2  Benchmark  two-mass/spring  system  for  robust  control  design 
and  analysis. 


where 


A(k)^ 


0 

0 

1 

0 

0 

0 

0 

0 

1 

,  B  = 

0 

-k 

k 

0 

0 

1 

k 

-k 

0 

0 

0 

_ 

_  _ 

0  0 
0  0 
0  0 
1  0 


(23) 


=  [0  1  0  0],  E)2  =  [0  1] 


The  Hi  cost  functional  under  consideration  is  defined  with 
respect  to  the  transfer  function  between  the  disturbance  w(/) 
and  the  performance  vector  z(/)  +  £'2w(/),  where  £2  -  VlO"  ^ 
The  perturbation  in  A(k)  due  to  a  change  in  the  stiffness 
element  k  from  the  nominal  value  /Cnom  is  given  by 

A(k)- A  {k„oJ  =  AA  =  -  BoAkCo  (24) 


where 


Co=[l  -  1  00] 


(25) 


In  the  subsequent  analysis  we  will  choose  k^^m  =  0.6  since  the 
controller  (20)  was  developed  under  this  assumption. 

Let  the  triple  (Ac,  Be,  Q)  denote  the  state-space  representa¬ 
tion  of  the  controller  (20).  Then,  assuming  negative  feedback, 
the  closed-loop  state  matrix  is  given  by 


A(k)^ 


A(k) 

BeC 


-BCc 

Ac  . 


(26) 


In  addition,  R  and  V  are  given  by  Eqs.  (10)  and  (1 1)  where 


BcDi. 


(27) 


was  designed  so  that  the  closed-loop  system  is  robust  with 
respect  to  perturbations  in  the  nominal  value  of  the  stiffness  k 
(i.e.,  k  =  A'nom)-  The  exact  stiffness  stability  region  over  which 
the  system  will  remain  stable  was  computed  by  a  simple  search 
and  is  given  by 


Next,  define 


Co  -  [Co  0i  X  4] 


(28) 


0.4458<Jt  <2.0661  (21) 

Next,  using  a  graphical  approach  and  the  state-space  Riccati 
equation  approach,  we  apply  small  gain  analysis,  positivity 
analysis,  and  Popov  analysis  to  determine  the  stiffness  stabil¬ 
ity  regions  predicted  by  each  of  these  tests.  Each  of  these  tests 
is  related  to  the  previous  test  and  is  guaranteed  to  be  less 
conservative. 

We  begin  by  constructing  the  uncertainty  feedback  system 
that  will  be  used  in  each  of  the  tests.  The  open-loop  plant  (for 
A77|  =  ^2  =  1)  is  given  by 


x(t)  =  A(k)xi!)  +  Bu(f)  +  D]W(t) 

(22a) 

y(/)  =  Cv(/)  +  Diwit) 

(22b) 

z(r)  -  £\x{t) 

(22c) 

and  recall 


A 

Bo  ' 

Co 

0  . 

Then,  the  plant  uncertainty  Ak  can  be  represented  by  the 
fictitious  feedback  loop  shown  in  Fig.  J  with  F  =  Ak.  Notice 
that  with  this  stiffness  uncertainty  CqBq  —  Q,  which  holds  for 
any  state-space  realization  of  the  system. 

IV.  Frequency  Domain  Graphical  Analysis  of  the 
Benchmark  System 

In  this  section  we  apply  the  frequency  domain  tests  de- 
scribed  in  the  three  theorems  of  Sec.  II  to  determine  Ak 
(positive)  and  M  (negative)  such  that  stability  is  guaranteed 

for  _ 

/^nom  +  M  <  ^  <  ^nom  +  A/c  (30) 
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Since  the  uncertainty  is  scalar,  we  will  first  use  the  graphical 
techniques  derived  from  the  frequency  domain  tests.  These 
graphical  tests  originally  appeared  in  Refs.  13  and  14  and  are 
included  here  for  comparison  with  the  results  based  on  the 
state-space  formulations. 


Small  Gain  Analysis 

Small  gain  analysis  requires  considering  the  Nyquist  dia¬ 
gram  of  G  (5).  The  smallest  circle  centered  at  the  origin  that 
completely  encompasses  the  Nyquist  diagram,  Im[C(/w)]  vs 
Re[G(/'w)]  for  all  oj,  (without  touching  it)  is  then  drawn.  The 
intersection  of  this  circle  with  the  negative  real  axis  is  given  by 
-  IM/:,  and  the  intersection  with  the  positive  real  axis  is 
given  by  -  1/^.  This  analysis  is  shown  in  Fig.  3.  It  follows 
that  i^k  =  0. 1497  and  ^  -  0. 1497.  Hence,  using  small  gain 

analysis,  stability  is  guaranteed  for 

0.4503 0.7497  (31) 


SMALL  GAIN  ANALYSIS 


Fig.  3  Frequency  domain  small  gain  analysis. 


Note  that  since  the  uncertainty  block  is  composed  of  a 
single  scalar,  this  result  is  equivalent  to  the  complex  structured 
singular  value  test.*^ 


Positivity  Analysis 

Positivity  analysis  determines  stability  bounds  by  drawing 
straight-lines  that  lie  to  the  left  or  right  of  the  Nyquist  diagram 
(without  touching  it).  For  the  Nyquist  diagram  of  G(s),  the 
intersection  of  the  line  to  the  left  of  the  Nyquist  plot  with  the 
negative  real  axis  equals  -  1/A/:.  The  intersection  of  the  line 
to  the  right  of  the  Nyquist  plot  with  the  positive  real  axis 
equals  -  1/A/:.  This  analysis  is  shown  in  Fig.  4.  It  follows 
that  Ak  =  0.5278  and  ^  -  0.1523.  Hence,  using  positivity 

analysis,  stability  is  guaranteed  for 

0.4477<J^<  1.1278  (32) 


Popov  Analysis 

Popov  analysis  is  a  test  that  determines  a  stability  bound 
from  a  modified  Nyquist  diagram,  namely,  the  Popov  plot, 
w  Im[G(/a>)]  vs  Re(G(y'a;)]  for  o)  >  0.  This  analysis  requires 
finding  lines  (Popov  lines)  that  intersect  the  negative  or  posi¬ 
tive  real  axis  at  a  point  that  is  to  the  left  of  the  Popov  plot  but 
as  close  to  the  origin  as  possible.  The  slopes  of  these  lines  are 

-  \/N  and  -  \/N  where  iV  and  N  are  the  Popov  multipliers. 
The  Popov  test  is  equivalent  to  the  positive  real  test  if  the  lines 
are  chosen  to  be  vertical.  For  the  Popov  diagram  of  G(s),  the 
intersection  of  the  line  to  the  left  of  the  Popov  plot  with  the 
negative  real  axis  equals  -  1/A/:.  The  intersection  of  the  line 
to  the  right  of  the  Popov  plot  with  the  positive  real  axis  equals 

-  1/A/:.  This  analysis  is  shown  in  Fig.  5.  It  follows  that  Ak 
=  1.4661  and  A^  =  0.1542,  and  the  corresponding  Popov 
multipliers  are,  respectively,  N*  -  0.7999  and  N*  =  -  0.2755. 
Hence,  using  Popov  analysis,  one  guarantees  stability  for 

0.4458  <  A:  <  2.0661  (33) 

Note  that  these  bounds  are  identical  to  the  exact  bounds  of 
Eq.  (21).  Hence,  for  this  example,  Popov  analysis  yields  to¬ 
tally  nonconservative  robust  stability  results.  This  is  not  sur¬ 
prising  since,  as  mentioned  in  the  Introduction,  the  Popov 
result  is  based  on  a  parameter-dependent  Lyapunov  function 
that  severely  restricts  the  allowable  time  variation  of  the  un¬ 
certain  parameters  and  hence  closely  approximates  real  pa¬ 
rameter  uncertainty  within  robustness  analysis. 


POSmVE  REAL  ANALYSIS 


Rod  Axis 


POPOV  ANALYSIS 


Fig.  4  Frequency  domain  positivity  analysis. 


Fig.  5  Frequency  domain  Popov  analysis. 
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V.  State-Space  Analysis  of  the  Benchmark  System 

Continuation  (or  homotopy)  algorithms'^’**'  are  effective 
techniques  for  solving  systems  of  nonlinear  algebraic  equa¬ 
tions  and  have  found  increasing  engineering  applications  (see, 
for  example,  Refs.  17-19).  In  this  section,  we  develop  contin¬ 
uation  algorithms  that  implement  the  state-space  analysis  re¬ 
sults  described  in  the  three  theorems  of  Sec.  IL  We  restrict 
ourselves  to  the  case  of  scalar  uncertainty  (i.e.,  Fis  a  scalar) 
with  Co^o  =  0  (which  applies  to  the  benchmark  system).  In 
addition,  the  exposition  is  focused  on  implementing  state- 
space  Popov  analysis  since  this  case  is  the  most  complex.  The 
algorithms  for  small  gain  and  positivity  analyses  are  very 
similar  and  hence  are  only  briefly  discussed.  The  results  of 
applying  these  algorithms  to  the  benchmark  problem  are  sub¬ 
sequently  presented. 

Each  of  the  algorithms  is  based  on  optimizing  the  cost  upper 
bounds  ]  of  Eqs.  (15),  (17),  and  (19).  At  this  point  we  focus 
attention  on  the  upper  bound,  Eq.  (19),  of  the  Popov  theo¬ 
rem,  rewritten  here  for  all  F  6  Ff^  as 

y (a,  N)  4  ( 1  /a)tr((P  +  C^MNCo)  V)  (34) 

where,  for  CoBq  =  0,  P  is  given  by 


0  =  +  PA  +  V/iKCo  +  NCqA  -  BlP)^M^Co 

+  NCaA  -BlP)  +  aR 


(35) 


The  algorithm  under  consideration  will  be  based  on  finding 
scalars  a  and  N  that  satisfy 

0  =  =  tT(QR  -  —APV  +  ClMNCo V))  (36) 

da 


-MCoPCl  +  M(Co  +  NCoA  -  BlP)QA  '^Cl  (37) 


and 

o=A^p{e,  \)+P{e,  \)A 
+  y2(Co  +  N(\)CoA-BlP(d, 

■  (Co  +  N(X)CoA  -  BlP(e,  X))  +  a(X)P  (44) 

0  =  (.4  -  ViBoM(\)(Co+N(\)CoA  -B^P(e,  \))]Q(e,  X) 

+  Q(e,  X)I/i  -  'A§oM(\)(Co  + ^0-)CoA 

-BlP(e,  (45) 

a(X) 

The  continuation  curve  is  defined  by 

0  =  H(e,  X),  X  €  [0,  1]  (46) 


where  Q  satisfies 

0  =  (A  -  ViBoM(Co  +  NCoA  -  BIP))Q 

+  QiA  -  ViBoM(Co  +  NCoA  -  BIP)Y  +  (1/a)  V  (38) 


Continuation  Map  for  Popov  Analysis 

To  define  the  continuation  map  we  assume  that  the  uncer¬ 
tainty  parameter  iVf  is  a  function  of  the  continuation  parame¬ 
ter  X  6  (0,  1].  In  particular,  it  is  assumed  that 

A/(X)  =  A/o  +  HMj  -  Mo)  (39) 

Note  that,  at  X  =  0,  A/(X)-A/o»  whereas  at  X=l,  A/(X)  =  Af/. 
The  continuation  map  is  defined  as  the  gradient  of  the  upper 
bound  on  the  cost  for  the  uncertainty  parameter  Af(X).  In 
particular. 


H(e,  x)4 


■//,(«.  X)' 
_H2(e,  X). 


(40) 


where 


Outline  of  the  Continuation  Algorithm  for  Popov  Analysis 

Step  1.  Initialize  loop-0,  X  =  0,  AX  6  [0,  1],  ^^=[1  0] 
(i.e.,  a=  1,  N -0). 

Step  2.  Let  loop  -  loop  +  1 .  If  loop  =  1 ,  then  go  to  step  4. 
Otherwise,  continue. 

Step  3.  Advance  the  homotopy  parameter  and  predict  the 
corresponding  parameter  vector  B  as  follows. 

3a.  Let  Xo  =  X. 

3b.  Let  X  — Xq-i-AX. 

3c.  Compute  HeiB,  X)  and  HyiB,  X).  Then  compute  d;(Xo) 
using 

Bp  (Xo)  =  -  [He(e,  X)]  -  Xo)  (49) 

3d.  Predict  0(X)  using  B{\)  =  ^(Xo)  +  AX^^  (Xo). 

3e.  If  \\H(B,  X)ll  satisfies  some  preassigned  prediction  tol¬ 
erance,  then  continue.  Otherwise,  reduce  AX  and  go  to  step  3b. 

Step  4.  Correct  the  current  approximation  ^(X)  as  follows. 

4a.  Compute  H(B,  X)  and  //^(X). 

4b.  Correct  ^(X)  using  ^(X)— ^(X)  --  {He(d,  X))  “  *//(d,  X). 

4c.  If  II// (d,  X)ll  satisfies  some  preassigned  tolerance,  then 
continue.  Otherwise,  go  to  step  4a. 

4d.  If  P(\)  is  not  nonnegative  definite,  then  go  to  step  5, 
since  stability  is  only  guaranteed  for  M  =  A/(Xo).  Otherwise, 
continue. 

4e.  Compute  the  upper  bound  J(0). 

4f.  If  X  ~  1,  then  continue.  Otherwise,  go  to  step  2. 

Step  5.  Stop. 

Continuation  Algorithm  for  Positivity  Analysis 

Recall  that  positivity  analysis  is  a  special  case  of  Popov 
analysis  (with  N  =  0).  Hence,  positivity  analysis  is  imple¬ 
mented  using  the  algorithm  for  Popov  analysis  with  N  con¬ 
strained  to  zero. 
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Continuation  Algorithm  for  Small  Gain  Analysis 

For  small  gain  analysis  we  consider  the  upper  bound  J  (a)  of 
Eq.  (15),  rewritten  here  as 

J{a)  =  (l/a)tr(PK)  (50) 


where 


0  =  '■/>  +  PA  +  M  -  +  ClCo  +  ctR  (51) 

The  algorithm  is  based  on  finding  a  scalar  a  such  that 


dJ  /  .  1  _ 

0  =  —  =  tr  -  -,PV 

da  \  a^ 


(52) 


where  Q  satisfies 

Q=(A  +M-  •BoBlP)Q  +  Q(^  +  M - +(i/a)V 

(53) 

It  is  assumed  that  A/(\)  is  as  given  by  Eq.  (39)  and  the 
continuation  map  is  defined  as 


H(e,  X)  =  tri  Q(d,  \)R  -  \,P(d,  X)P 

ot* 


(54) 


where 


(55) 


Cost  Bounds  for  Vtrlout  Robustzien  Tests 


Fig.  6  Performance  bounds  for  the  small  gain,  positivity,  and  Popov 
tests. 


opdmum  cost  scailnf  for  vtiious  robuscneM  tests 


Fig.  7  Optimal  a  for  the  small  gain,  positivity,  and  Popov  tests. 


opcUnum  popov  multiplier  for  robustness  test 


Fig.  8  Optimal  N  for  the  Popov  lest. 


0  =  A'^Pifi,  X)  +  P(^,  X)/i 

+  M{\)  -  ^P(9,  \)BoB^P(d,  X)  +  Co’^Co  +  aR  (56) 

0  =  (^  +  M(\)-^BoBlP(e,  \))Q(,d,  X) 

+  Q{d,  \)(^  +M{\)-^BoBoP(.S,  \)y+(\/a)y  (57) 

The  continuation  curve  is  defined  by 

0  =  X),  XE(0,  1]  (58) 

Expressions  for  the  Hessian  Hs  and  Hx  are  given  in  the  Ap¬ 
pendix. 

The  outline  of  the  continuation  algorithm  for  small  gain 
analysis  is  identical  to  that  given  for  Popov  analysis.  Because 
of  this,  no  further  discussion  is  needed. 

Analysis  of  the  Benchmark  Problem 

When  the  continuation  algorithms  for  small  gain,  positivity, 
and  Popov  analysis  are  applied  to  the  benchmark  problem,  the 
performance  curves  shown  in  Fig.  6  result.  As  expected, 
Popov  analysis  yields  less  conservative  results  than  the  positiv- 
ity  and  small  gain  tests.  The  robust  stability  bounds  Ak  (posi¬ 
tive)  and  4^  (negative)  obtained  from  the  state-space  tests  are 
identical  to  those  obtained  from  the  frequency  domain  tests  of 
Sec.  IV.  The  optimal  a  for  each  test  is  shown  in  Fig.  7  as  a 
function  of  M.  The  optimal  N  for  the  Popov  test  is  shown  in 
Fig.  8.  Note  that  as  A/ approaches  its  supremum  and  infimum, 
N  converges,  respectively,  to  N*  and  N*  obtained  from  the 
graphical  test. 

VI.  Conclusions 

This  paper  has  discussed  the  small  gain,  positivity,  and 
Popov  tests  and  applied  both  the  (graphical)  frequency  do¬ 
main  version  of  each  test  and  the  corresponding  state-space 
test  to  a  benchmark  problem.  The  frequency  domain  tests  and 
the  state-space  tests  were  seen  to  give  identical  results  for 
robust  stability,  and  the  Popov  test  was  completely  nonconser¬ 
vative  in  its  robustness  predictions.  The  state-space  tests  also 
yielded  robust  Hi  performance  bounds  and  were  implemented 
using  continuation  algorithms.  The  algorithms  developed  here 
only  apply  to  the  special  case  of  scalar  uncertainty  and  the 
algorithm  for  the  Popov  test  further  requires  that  a  certain 
product  (related  to  the  uncertainty  pattern)  is  zero.  Future 
work  will  involve  the  development  of  more  general  numerical 
algorithms. 

Appendix:  Jacobian  Expressions  for  the 
Popov  and  Small  Gain  Tests 
In  this  Appendix  we  show  how  to  compute  the  Jacobian  of 
the  homotopy  map  X)  for  both  the  Popov  and  small  gain 
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tests.  We  first  recall  that  the  Jacobian  X)  is  defined  by 


vH{e,  i//„  /fxl 


Since  H{B,  X)  corresponds  to  the  upper  bounds  of  the  cost 
corresponding  to  A/(X),  Hq  is  the  corresponding  Hessian. 

Jacobian  Expressions  for  Popov  Analysis 


£«,(«.  X)  ^,(».X) 


a\  a 

bP 

+  {Mf  -  Mo)(Co  +  NC^  -  BlP)Q  -  M61 — G 


Td\^I  XTnT 


+  A/(Co  +  NCji  -  BIP)-^]A  (A14] 

and  dP/d\  and  dQ/d\  satisfy 
^  ^^bP  bP  j 

+  '/2(Co  +  NCoA  -  BlP)(Mf  -  Mo)(Co  +  NCoA  -  B^P) 


=tr(^/? ^y  +  -,  (PV  +  CIMNCoV))  (A4) 

da  \da  a^  oa  Gif’  / 


a  /  .^bP  -  .  .  ao 

JJ^2={-MBr—Q^M(Co  +  NC^ -B^P)^ 


+  MCoAQ)A^Q 


(A6) 

BN  \bN  a"  bN  J 


and  bP/ba,  bP/bN,  bQ/ba,  and  a Q/aA^  satisfy 
^  ^^bP  bP  ^  . 

0  -  Ag—  ~Aa  +  p 
ba  da 

bP  bP 

0  =  A  I—  +  —  Aa  +  >/2  [(Co  +  NCoA  -  BlP)T'MCoA 
bN  bN 


+  A  (C  0  +  NCoA  -  B^P)] 


-  \-BaMCoA JQ-  Q\^-BoMCoA 


A,^A  -  ViBoMiCo  +  NCoA  -  B^P)  (A1 1) 


Similarly,  //x  is  given  by 


X) 


:H2(e,  X) 


+  )e  *  )' 


-Bo(Mf  -  Mo)(Co  +  NCoA  -  BjP)  Q 


-  Q  -Bo(Mf  -  Mo){Co  +  NCoA  -  BlP) 


Jacobian  Expressions  for  Small  Gain  Analysis 
The  Hessian  Hb(  =  bH/bd)  is  given  by 

\ba  a^  ba  a^ 
where  bP/ba  and  bQ/ba  satisfy 

0=A^^  +  ^A+i? 
ba  ba 


0  =  (A  +  M  -  '^BoBjP)^  +  ^(A  +  M -^BoB^PV 
ba  ba 

bP  /  bP  1 

+  M - ^BoBl^Q  +  {m- ^BoBl—Q]  --^V  (A  1 9) 


Similarly,  H\(^dH/dX)  is  given  by 


ax  a^  ax 


Hx^trir^R 


where  bP/b\  and  bQ/b\  satisfy 

bP  a  p 

0  =  (A  +M-^BoBlPf—  +  —(A  +M-'‘BoSoP) 
OA  oA 

-  2M  -  \Mf  -  Mo)PBoBlP 
0  =  (A +M-^5o^o^P)^  +  ^{A  +M-^SoBjP)^ 

OA  OA 

+  M  -  ^BoBJ^Q  +  -  ^BoBo’^q) 

Mo)(BoSoPQ  +  QPBoiSl ) 
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Abstract 

An  important  part  of  feedback  control  involves  analyzing  uncertain  systems  for  robust 
stabihty  and  performance.  Many  robustness  theories  consider  only  stability  issues  and 
ignore  performance.  Most  of  the  performance  robustness  results  that  do  exist  will  not 
always  yield  finite  performance  bounds  for  the  case  of  closed-loop  systems  consisting  of 
uncertain  positive  real  plants  controlled  by  strictly  positive  real  compensators.  These 
results  are  obviously  conservative  since  this  class  of  systems  is  unconditionally  stable. 
This  paper  uses  majorant  analysis  to  develop  tests  that  yield  finite  performance  bounds 
for  the  above  case.  The  results  are  specialized  to  the  case  of  static,  decentralized  colocated 
rate  feedback  and  dynamic  colocated  rate  feedback. 


This  research  was  sponsored  in  part  by  the  Air  Force  Office  of  Scientific  Research 
under  Contract  F49620-92-C-0019,  and  the  National  Science  Foundation  under  Grants 
ECS-91095588  and  ECS-9350181. 


1.  Introduction 


A  central  issue  in  feedback  control  is  the  analysis  of  uncertain  systems  for  robust  stabil¬ 
ity  and  performance.  Hence,  considerable  effort  has  been  devoted  by  researchers  in  control 
to  the  development  of  effective  robustness  analysis  tools.  Many  of  the  developments  in 
robustness  analysis  have  focused  exclusively  on  the  determination  of  stability.  However,  in 
practical  engineering,  performance  issues  axe  paramount,  so  that  it  is  important  to  addi¬ 
tionally  determine  the  type  of  performance  degradation  that  occurs  due  to  the  uncertaunty 
in  the  system  modeling.  References  [1-13]  are  examples  of  robustness  analysis  techniques 
that  do  consider  performance.  A  common  feature  of  a  class  of  these  results  [5-8]  is  that 
they  rely  on  majorant  bounding  techniques  [14-16]. 

Majorant  theory  was  originally  developed  by  Dahlquist  to  produce  bounds  for  the 
solutions  of  systems  of  differential  equations  [16].  The  corresponding  bounding  techniques 
focus  on  providing  upper  bounds  on  subblocks  of  matrices  and  inverse  matrices.  Similar 
bounding  procedures  have  been  used  in  the  work  of  researchers  in  large  scale  systems 
analysis  [17,18].  The  more  recent  results  of  [5-8]  apply  majorant  techniques  to  produce 
robust  performance  bounds  for  uncertain  linear  systems. 

In  [5-8]  performance  is  measured  in  basically  three  ways.  References  [5]  and  [6]  measure 
performance  in  terms  of  second  order  statistics.  In  particular,  bounds  are  obtained  on  the 
steady  state  variances  of  selected  system  variables.  In  [7],  performance  is  expressed  in 
terms  of  the  frequency  response  of  selected  system  outputs.  This  result  led  to  a  new  upper 
bound  for  the  structured  singular  value.  Finally,  [8]  considers  the  transient  response  of 
certain  system  outputs,  a  performance  measure  which  had  not  previously  been  treated  in 
the  robustness  literature.  A  common  feature  of  these  results  and  most  other  robustness 
results,  with  the  possible  exception  of  methods  based  on  extensions  of  Popov  analysis  and 
parameter-dependent  Lyapunov  ftmctions  [11-13],  is  that  they  do  not  predict  unconditional 
stability  for  feedback  systems  consisting  of  a  positive  real  plant  controlled  by  a  strictly 
positive  real  controller. 

This  paper  uses  the  logarithmic  norm  in  context  of  majorant  analysis  to  develop  tests 
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for  robust  stability  and  performance  that  predict  unconditional  stability  for  the  above 
case  and  also  yield  robust  performance  bounds.  As  in  [1,2,7,10]  this  paper  considers  the 
frequency  domain  behavior  of  a  given  system.  The  results  axe  specialized  to  the  case  of 
static,  decentralized  colocated  rate  feedback  and  dynamic,  colocated  rate  feedback.  The 
bounds  developed  here  axe  illustrated  with  examples  chosen  from  this  class  of  problems 
and  compaxed  with  the  performance  bound  obtained  in  [7]  and  the  performance  bound 
resulting  from  complex  structured  singular  value  analysis  [1,2].  It  is  seen  that  the  new 
bounds  are  much  less  conservative  than  the  alternative  bounds. 

The  paper  is  organized  as  follows.  Section  2  presents  notation  and  the  necessary  math¬ 
ematical  foundation.  Section  3  gives  results  relating  to  strictly  positive  real  feedback  of  a 
positive  real  system.  Section  4  develops  robust  performance  bounds  for  the  aforementioned 
systems.  Section  5  specializes  the  performance  bounds  to  the  case  of  static,  decentralized 
colocated  rate  feedback.  In  Section  6  we  extend  the  results  of  Section  5  to  dynamic,  cen¬ 
tralized  output  feedback  and  present  a  systematic  approach  for  designing  strictly  positive 
real  compensators.  In  order  to  draw  compaxisions  to  the  robust  performance  bounds  de¬ 
veloped  in  Section  5  and  6,  Section  7  presents  a  brief  summary  of  the  results  developed  in 
[7]  and  [1,2]  involving  an  alternative  majorant  bound  and  the  complex  structured  singular 
value  bound  respectively.  Section  8  presents  several  illustrative  examples  that  demonstrate 
the  effectiveness  of  the  proposed  approach.  Finally,  Section  9  presents  conclusions. 


2.  Notation  and  Mathematical  Preliminaries 


In  the  following  notation,  the  matrices  and  vectors  aXe  in  general  assumed  to  be  com¬ 


plex. 

m 

C 

z* 

z^ 

or  Z^j 

diag{2:i,...,2„} 
Y  <<Z 


set  of  real  numbers 

set  of  complex  numbers 
p  xp  identity  matrix 

complex  conjugate  of  matrix  Z 

complex  conjugate  transpose  of  matrix  Z  (=  (Z*)"^) 

(i,j)  element  of  matrix  Z 

diagonal  matrix  with  listed  diagonal  elements 

Vij  ^  Zij  for  each  i  and  j,  where  Y  and  Z 

are  real  matrices  with  identical  dimensions 
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|al 

det(Z) 

11^112 

0‘inin('^)>  ^ma.x(^) 

ll^lls 

II^IIf 

p{Z) 

C[Z{t)] 

^min  (<?)  ?  ^max  (0) 

max{y’i, . . . ,  in} 


absolute  value  of  complex  scalar  a 
determinant  of  square  matrix  Z 
Euclidean  norm  of  vector  x  (=  y/x^x) 
minimum,  maximum  singular  values  of  matrix  Z 

spectral  norm  of  matrix  Z  {  =  (TmtLx{Z)), 
subordinate  to  the  Euclidean  norm^ _ 

Probenius  norm  of  matrix  Z  (^  = 

V  ‘  ' 

spectral  radius  of  a  square  matrix  Z 
Laplace  transform  of  Z{t) 

minimum,  maximum  eigenvalues  of  the  Hermitian  matrix  Q 
=  Y  where  t/ij  =  max{j/i, , -y,  j/2, ij,  •  •  •  >  yn,ij} 


Let  A  €  Then,  the  modulus  matrix  of  ^  is  the  m  x  n  nonnegative  matrix 

I^Im  =  Doyll-  (2-1) 

The  modulus  matrix  is  a  special  case  of  a  block  norm  matrix  [14,15]. 

Let  5  €  Subsequent  analysis  will  use  the  following  relation 


|AB|m  <<  I^ImI^Im. 


(2.2) 


A  majorant  [16]  is  an  element-by-element  upper  bound  for  a  modulus  matrix  (or  more 
generally,  a  block  norm  matrix).  Specifically,  A.  is  an  m  x  n  majorant  respectively  of 
A  e  if 


|.A|m  <<  A. 

Let  Z  €  Then  Z  €  IR"^”  is  an  n  x  n  minorant  [16]  of  Z  if 

Xii  ^ 

zij<-\zij\,  i^j. 


(2.3) 


(2.4a) 

(2.4&) 


Lemma  2.1.  Let  Zd  and  Zod  denote  respectively  the  diagonal  and  off-diagonal  com¬ 
ponents  of  Z  €  such  that 

Zd  =  diag{^, Zod  =  Z  —  Zd-  (2.5) 
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Then,  if  Za  is  an  n  x  n  minorant  of  Za  and  ZoA  is  a  majorant  of  Zoa ,  Za  —  ZoA  >s  a  minorant 
of  Z. 


The  logarithmic  norm  [16,19]  of  Z  €  with  respect  to  the  spectral  norm  is  defined 


by 


lim 

fc-+0+ 


||/+fe^||s-l 

h 


(2.6) 


or,  equivalently  [19], 

t(Z)=|a„„(Z  +  Z''). 


(2.7) 


A  matrix  P  €  IR"^”  is  an  M-matrix  [20-22]  if  it  has  nonpositive  off-diagonal  elements 
(i.e.,  pij  <  0  for  i  ^  j)  and  positive  principal  minors.  It  has  been  shown  [20-22]  that  the 
inverse  of  an  M-matrix  is  a  nonnegative  matrix. 

The  next  five  lemmas,  especially  Lemmas  2.4  and  2.6,  are  key  to  the  development  of 
the  robust  performance  bounds  of  the  following  sections.  The  proofs  of  these  lemmas  are 
based  on  the  relationship  between  minorants,  logarithmic  norms,  and  M-matrices. 

Lemma  2.2.  Let  Z  €  C”^".  Then  Z  €  IR"^”  is  a  n  x  n  minorant  of  Z  if 

^ii  ^  ^ii)^  (2'8) 


or 


and 


Zii  ^  Q^ji^Zii  Zj^)\, 

(2.9) 

Zij<-\zij\,  i^j. 

(2.10) 

Proof.  It  follows  from  equation  (3.1)  of  [16]  that  Z  is  an  n  x  n  minorant  of  Z  if 


Zii  <  -T{-Zii),  (2.11) 

and  (2.10)  is  satisfied.  Substituting  (2.7)  into  (2.11)  yields  (2.8).  Hence  Z  satisfying  (2.8) 
and  (2.10)  is  a  n  x  n  minorant  of  Z. 
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Next  recognizing  that  a  minorant  of  is  also  a  minorant  of  ±;Z,  it  follows  by 
replacing  Z  by  ±jZ^  in  (2.8)  and  (2.10)  that  (2.9)  and  (2.10)  define  a  n  x  n  minorant  of 
Z.  □ 

Lemma  2.3.[16].  Assume  Z  €  and  let  Z  be  an  n  x  n  minorant  of  Z.  If  in 

addition  Z  is  an  M-matrix,  then 


IZ-^Im  <<  Z-\ 


(2.12) 


The  next  lemma  is  an  immediate  consequence  of  Lemmas  2.2  and  2.3. 

Lemma  2.4.  Assume  Z  €  and  Z  €  IR”^"  satisfies 

Zii  <  maxj ^(zii  +  Zii),  ^ \j{zii  -  ^,*  )|} ,  (2.13a) 

Zij<-\zijl  i^j.  (2.135) 

Then,  Z  is  a  n  x  n  minorant  of  Z.  Furthermore,  if  Z  is  an  M-matrix,  then 

\Z-'^\u<<Z-\  (2.14) 


Lemma  2.5.  let  Q  G  and  let  5  be  a  positive  scalar  satisfying  either 


(2.15) 

or 

(2.16) 

Then, 

(2,17) 

Proof.  It  follows  from  Proposition  1  and  equation  (3.1)  of  [16]  that  any  positive  scalar 
satisfying 

q<-r{-Q)  (2.18) 

also  satisfies  (2.17).  Substituting  (2.7)  into  (2.18)  yields  (2.15).  Since  \\±jQ~^  ||s  =  ||Q~^  ||s) 
Q  in  (2.15)  can  be  replaced  by  ±3Q  which  yields  (2.16).  □ 
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An  immediate  extension  to  Lemma  2.5  is  as  follows. 

Lemma  2.6.  Let  Q  €  and  let  5  be  a  positive  scalar  satisfying 

+  (2-19) 

Then, 

IIO-'ll.<£-'-  (2.19) 

Lemma  2.7.[23].  Let  A,  B  E  Then, 

^min(A  -J-  S')  ^  ^min(A)  ^max(.®)*  (2.20) 

The  next  lemma  is  a  direct  consequence  of  Theorem  4.3.1  of  [23]. 

Lemma  2.8.  Let  A,  B  E  C”^"  be  Hermetian  and  let  Aniin(A),  Amin(-S),  and  Ainin(A  + 
B)  denote  the  minimum  eigenvalues  of  the  respective  arguments.  Then, 

Amin(-'4.  +  B)  ^  Ainin(A)  Ainin(.®)*  (2.21) 

Finally,  we  establish  certain  definitions  and  a  key  lemma  used  later  in  the  paper. 
Specifically,  a  real-rational  matrix  fucntion  is  a  matrix  whose  elements  are  rational  func¬ 
tions  with  real  coefficients.  Furthermore,  a  transfer  function  is  a  real-rational  matrix  each 
of  whose  elements  is  proper,  i.e.,  finite  at  s  =  oo.  A  strictly  proper  transfer  function  is 
a  transfer  function  that  is  zero  at  infinity.  An  asymptotically  stable  transfer  function  is 
a  transfer  function  each  of  whose  poles  is  in  the  open  left  half  plane.  Finally,  a  stable 
transfer  function  is  a  transfer  function  each  of  whose  poles  is  in  the  closed-left  half  plane 
with  semi-simple  poles  on  the  juj  axis.  Let 


denote  a  state  space  realization  of  a  transfer  function  G(s),  that  is,  G{s)  =  C{sI—A)~^B-\- 
D.  The  notation  “  is  used  to  denote  a  minimal  realization.  The  H2  norm  of  an 
assymptotically  stable  transfer  function  G{s)  is  defined  as 

I|G^WI|2=(^  y^l|G(ycu)|||da;)i  (2.22) 
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A  square  transfer  function  G(s)  is  called  positive  real  [24]  if  1)  G(s)  is  stable,  and  2) 
G(s)  +  G^{s)  is  nonnegative  definite  for  all  Re[s]  >  0.  A  square  transfer  function  G(s)  is 
called  strictly  positive  real  [25-27]  if  1)  G{s)  is  asymptotically  stable,  and  2)  G{ju>)+G^{ju}) 
is  positive  definite  for  all  real  lo.  Recall  that  a  minimal  realization  of  a  positive  real  transfer 
function  is  stable  in  the  sense  of  Lyapunov,  while  a  minimal  realization  of  a  strictly  positive 
real  transfer  function  is  asymptotically  stable. 


Next  we  state  the  well  known  positive  real  lemma  [28]  used  to  characterize  positive 
realness  in  the  state-space  setting. 

Lemma  2.9.  The  strictly  proper  transfer  function  G(s) 


min 

A 

B 

C 

0 

is  pos¬ 


itive  real  if  and  only  if  there  exist  matrices  Qo  and  L  with  Qo  positive  definite  such  that 


■AQo  "b  —  — LLP"  ^ 


(2.23) 


QoC^  =  B. 


(2.24) 


This  form  of  the  positive  real  lemma  is  the  dual  of  that  given  in  [28],  and  the  derivation 
is  similarly  dual.  See  [29]  for  further  details  on  the  dual  positive  real  lemma. 

A  linear  time-invariant  system  with  input  w,  output  y,  and  transfer  function  represen¬ 
tation 

y{s)  =  G{s)w{s)  (2.25) 

is  stable  if  G{s)  is  rational,  stable,  and  proper.  This  definition  of  system  stability  is 
equivalent  to  bounied-input,  bounded- output  stability. 

3.  Positive  Real  Plants  with  Strictly  Positive  Real  Feedback 

We  begin  by  considering  the  following  n*^-order,  uncertain,  second-order  matrix  linear 
plant  with  proportional  damping  and  rate  measurements; 

ii(t)  -f  2ACtiq{t)  -f  Q‘^rj{t)  =  Bu{t)  +  Dw(t), 
y{t)  =  Ci^{t), 
z{t)  =  Ei^{t), 
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(3.1a) 

(3.16) 

(3.1c) 


where 


=  diag{fti}”_i,  >  0  for  *  €  {1,2, .. .  ,n}, 

(3.2) 

A  =  diag{Ci}-Li,  Ct  >  0  for  *  ^  {l,2,...,n}. 

(3.3) 

u  6  ni”“  is  the  control  vector,  w  €  IR”"  is  the  disturbance  variable  or 

reference  signal, 

y  €  IR'**'  represents  the  rate  measurements,  and  z  €  IR”*  represents  the  performance 
variables  (restricted  to  be  linear  functions  of  the  modal  rates).  It  is  assumed  that 

fi  €  n  =  {Oo  +  Aft  :  |Aft|M  << 

(3.4) 

A  €  A  =  {Ao  +  AA  :  jAAin  << 

(3.5) 

B€B  =  {Bo  +  AB:  |AB|m  << 

(3.6) 

DeB  =  {Do  +  AD:  |AI>|m  <<  AD}, 

(3.7) 

CeC  =  {Co  +  AC:  |AC|m  << 

(3.8) 

E€E  =  {Eo  +  AE:  |A£;|m  <<  A^}- 

(3.9) 

Next,  define 

=(ft,A), 

(3.10) 

(3.11) 

(3.12) 

and  define  Hi,  H2,  and  H3  to  be  the  corresponding  uncertainty  sets,  i.e.. 

Hi  =  {(ft,A):fteft,  AeA}, 

(3.13) 

H2  =  {{B,C):BeB,  CeC}, 

(3.14) 

H3  =  {{D,E):DeB,  £?€£}. 

(3.15) 

Additionally,  define 

H  =  HiUH2UH3. 

(3.16) 

Note  that  Hi  is  the  uncertainty  set  corresponding  to  errors  in  the  frequencies  and  damping 
ratios  while  H2  and  H3  are  uncertainty  sets  corresponding  to  errors  in  the  mode  shapes. 
It  follows  from  (3.4)-(3.9)  that  Hi,  H2,  and  H3  are  arcwise  connnected. 
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Furthermore,  define 

e{s)  =  £[»7(t)], 

so  that  (3.1)  has  the  s-domain  representation 


where 


and 


Note  that  for  all  Hi  €  Hi ,  $(ifi ,  s)  is  strictly  positive  real,  so  that 

+  ifi  €  Hi,  a>€(0,oo). 


(3.17) 


$  ^{Hi,s)9{H,s)  =  Bu{s)  +  Dw{s), 

(3.18a) 

y{H,s)  =  Ce{s), 

(3.186) 

z{H,s)  =  Ee{s), 

(3.18c) 

$(Fi,s)4diag{?i.(fri,s)};Lj, 

(3.19) 

(3.20) 

(3.21) 


If,  alternatively,  the  system  is  undamped,  that  is,  Ct  =  0,  i  =  l,...,n,  then  (3.19)  is 
positive  real. 

To  make  the  model  more  realistic  we  now  include  sensor  and  actuator  dynamics  that 
are  assumed  to  be  known.  (These  dynamics  could  be  empirically  determined  via  hard¬ 
ware  experimentation.)  The  matrix  of  actuator  dynamics  (^a)  and  the  matrix  of  sensor 


dynamics  ('i's)  are  given  respectively  by 

$a(5)  =  diag{^o,,(s)}”^i,  (3.22) 

^,(s)  =  diag{^,,i(s)}”^i .  (3.23) 

Appending  these  dynamics  to  the  system  (3.13)  yields 

{Hi ,  s)9{H,  s)  =  B^a(s)tt(s)  +  Dw{s),  (3.24a) 

y{H,s)=^'^s{s)Ceis),  (3.246) 

z{H,s)  =  E${s).  (3.24c) 

9 


Next,  assume  that  the  linear  feedback  law 


t/(s)  =  -K{s)yis)  (3.25) 

stabilizes  the  nominal  system,  i.e.,  the  system  (3.24)  with  Hi  —  (fiojAo)  and  H2  — 
{Bo, Co).  Substituting  (3.25)  into  (3.24a)  gives 

[^-\Hi,s)  +  F{H2,s)]e{H,s)=Dwis),  (3.26) 


where 

F{H2,s)  ^  B^a{s)K{s)^,{s)C.  (3.27) 


Now  define  Gwe{H,s)  to  be  the  transfer  function  between  tz;(s)  and  6{H,s),  such  that 

d{H,  s)  =  G,,ff(H,  s)w(s).  (3.28) 

Then,  the  following  proposition  is  needed  for  Theorem  3.1. 

Proposition  3.1.  For  given  H  ^H,  Gwfi(H,s)  is  asymptotically  stable  if 

det[$-'(iri,ja;)  +  F(Zf2,Ju;)]  /  0,  u;  G  [0,oo).  (3.29) 


Proof.  The  result  is  a  direct  consequence  of  the  multivariable  Nyquist  criterion.  □ 

The  proof  of  the  following  theorem  relies  on  Proposition  3.1.  For  the  statement  of  the 
next  result  let  Q  ;  H  — ^  and  define  t/(Q)  by 

i-(Q)  =  iA„i„(e(F)  +  Q"(S)),  (j(Q(ff)  -  Q^iH))), 

(3.30) 

Theorem  3.1.  If  for  all  H2  G  H2,  F{H2,s)  is  positive  real,  then  Gwe{H,s)  is  asymp¬ 
totically  stable  for  all  if  G  H  (that  is  Gxt,e{H,  s)  is  robustly  stable).  In  addition. 


[^-\Hi,ju)  +  F{H2,jlo)]-^ 


<p 


(3.31) 
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where  is  any  positive  scalar  satisfying 

M  +  F(jlj)].  (3.32) 

Proof.  First  note  that  is  strictly  positive  real  for  all  Hi  €  Hi.  We  now  show 

that  is  invertible  and  is  strictly  positive  real. 

Let  Hi  €  Hi,  X  €  C”,  x  ^  0,  and  A  €  C  be  such  that  ^{Hi,ju})x  =  Ax  and  hence 
x^^{H,ju})  =  \^x^.  Then,  x^\^{Hi,ju})  +  $^(ifi,ja>)]x  >  0  implies  Re  A  >  0.  Hence 
det[$(H^i,ja>)]  ^  0.  In  addition, 

^-\Huji^)  +  $-"(ifi,ja;)  =  $-i(J?i,ja;)[$(iri,ya;)  +  >  0, 

which  implies  that  $“^(ifi,s)  is  strictly  positive  real.  Since,  for  all  H-i  €  H2,  F(H2,s) 
is  positive  real  it  follows  that  for  all  Hi  €  Hi  and  H2  €  H2,  [$“^(ifi,s)  +  F(if2)5)]  is 
strictly  positive  real  and  thus  (3.29)  is  satisfied.  Hence,  it  follows  from  Proposition  3.1 
that  Gwe(s)  is  asymptotically  stable  for  all  ff  €  H. 

Now,  for  Hi  €  Hi  and  H2  €  H2,  $~^(iri,s)  +  F(H2,s)  is  strictly  positive  real  and 
hence  +F(ja;)]  is  positive.  Equation  (3.31)  then  follows  using  Lemma  2.6.  □ 

Remeirk  3.1.  The  first  part  of  the  proof  to  Theorem  3.1  is  essentially  identical  to  the 
proof  of  Lemma  3.2  of  [30]. 

Remark  3.2.  The  norm  bound  (3.31)  lays  the  foundation  for  one  of  the  performance 
bounds  given  in  the  next  section. 

Remeirk  3.3.  Note  that  Theorem  3.1  also  holds  if,  alternatively,  the  plant  is  positive 
real  and  the  compensator  is  strictly  positive  real. 

Remark  3.4.  Note  that  in  the  scalar  case  the  definition  of  u{Q)  cem  be  specialized  to 
i/(Q)  =  max|^n  ^((5(ff)  +  (5*(ff)),  m\^\j{Q{H)  -  Q*(if))|  J.  (3.33) 
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4.  Performance  Bounds 


In  this  section  it  is  again  assumed  that  F(H2,s)  is  positive  real  for  all  H2  €  Hj.  We 
define 

r(ir„^2,s)=  +  (4.1) 

and  note  that  in  this  case  (3.26)  yields 


d{H,s)  =V{HuH2,s)Dw{s).  (4.2) 

Let  T{ju))  denote  a  majorant  of  T{Hi,H2,Ji^j)  for  all  Hi  6  Hi  and  H2  €  H2,  such  that 

|r(fri,.ff2,;u;)|M<<f(jw).  (4.3) 

Hi€Hi 


Then,  applying  the  inequality  (2.2)  to  (4.2)  gives 

max  I  0(H,juj)  |m<<  \  i«(j‘4;)|m. 

HeH 

Similarly,  applying  the  inequality  (2.2)  to  (3.24c)  and  using  (4.4)  gives 

\z{3<^)  |m<<  |jE|m^(jw), 

where 

B{juj)  =  f  (ju;)I>|u>(ja;)|M. 


(4.4) 


(4.5) 


(4.6) 


Equations  (4.5)  and  (4.6)  indicate  that  performance  bounding  requires  the  compu¬ 
tation  of  r(jw)  satisfying  (4.3).  The  following  two  theorems  present  alternatives  for  the 
choice  of  r(jw).  The  first  theorem  follows  directly  from  Theorem  3.1. 

Theorem  4.1.  Assume  that  for  all  H2  €  H2,  F(H2is)  is  positive  real  and  p(ju?)  is  a 
positive  scalar  satisfying  (3.32).  Then 

\T(Hi,H2,joj)\M<<t'oijuj),  (4.7) 

HicHi 

H26H2 

where 


and  Un  denotes  the  n  xn  matrix  with  all  unity  elements. 

Let  E)”  denote  the  set  of  n  xn  diagonal  matrices,  let  (•)  have  the  mapping  Q  :  H  ID", 
and  define  the  function  ud{Q)  hy 

ud{Q)  =  <iiag{i/(9ti)}r=i* 

We  are  now  prepared  to  state  the  next  theorem. 

Theorem  4.2.  Assume  that  for  all  H2  €  H2,  F(H2,s)  is  positive  real  and  let 
FdiH2,s)y  and  Fod{H2,s)  respectively  denote  the  diagonal  and  off-diagonal  matrices  cor¬ 
responding  to  F{H2,s),  such  that 


Fd{H2,s)  =  diag{/i,(if2,5)}!Lj, 

(4.10) 

Fod{H2,s)  =  FiH2,s)-Fd(H2,s). 

(4.11) 

Let  n(juj)  be  given  by 

=  P(ju>)  -  FodO^), 

(4.12) 

where  is  diagonal  and  satisfies 

F^w)  <<  +  Fd{H2,joj)), 

(4.13) 

and  FodO^*^)  satisfies 

[FodOw)]ij  >  m^  |[Fod(F2,ja;)]i_,|. 

HsCHs 

(4.14) 

Then, 

max  1  r(ja;)  |m<< 

ffisHi 

(4.15) 

Proof.  First  note  that  T(Hi,H2,s)  is  given  by 

r(»i,if2,s)=  [5d(ir,,ir2,s)  +  Fod(ir2, *)]■',  (4.16) 

where 

=  i-'(Hus)  +  Fi(H2,s).  (4.17) 
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Let  5d(;a;)  be  a  minorant  of  Sd(Hi,H2,30j),  and  let  FodO^)  satisfy  (4.14)  for  all  if  €  H. 
Furthermore,  if  —  Fod(jw)  is  an  M-matrix  it  follows  from  Lemma  2.3  that 

|r(;a;)|M  <<  [^d(ja;)  -  Fod(jcu)]-^  (4.18) 

Since  uoiSdiji^))  is  a  minorant  of  5d(ifi,if2,;‘*^),  so  is  P(ja;)  and  hence  the  proof  is 
complete.  □ 

Remark  4.1.  Note  that  for  the  case  n  =  1  Theorems  4.1  and  4.2  yield  the  same 
bound.  However,  in  the  case  n  >  1  the  performance  bound  is  obtained  by  computing  the 
minimum  of  the  bounds  given  by  Theorems  4.1  and  4.2. 


5.  Performance  Bounds  for  Colocated  Rate  Feedback 


In  this  section  we  give  performance  bounds  for  decentralized  colocated  rate  feedback 
systems.  Specifically  we  assume  that 

C  =  (5.1) 

^a{s)  =  ’I'3(s)  =  I„,  (5.2) 

K(s)  =  kk'^,  (5.3) 

where 

K  =  diag{K:j}^i.  (5.4) 


Hence, 


(5,5) 


We  now  show  how  to  practically  compute  bounds  corresponding  to  Theorems  4.1  and  4.2. 
First,  however,  define  :  IR  — » IR  as 


a  >  0 

a  <  0. 


(5.6) 


We  begin  by  showing  how  to  compute  a  positive  scalar  satisfying  (3.32)  with 

u{‘)  given  by  (3.30).  Using  Lemma  2.8  it  follows  that 

A„i„[«-*(iri,;u.)  +  F(H2,ju)  +  +  F”(H2,  Jii)] 

(5.7) 

>  A„i„[$-'(iri,>;)  +  +  A„,.[j’(ir2,jw)  +  F''(.ff2, ;>.-)).  ' 
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Now, 

(5.8) 

=  diag{4(Co,fc  +  ACo,Jb)(J^o,it  +  Afio.it)}- 

Hence, 


min  =  nun2(Co.fc  -  ^CkX^o.k  -  AQ*)-  (5-9) 

HisH,  2  * 

Furthermore, 

F{H2,ju})  +  F^(H2,ju})  =  2Bkk'^B'^.  (5.10) 

Note  that 

=  2.7^1.  ((B,+AB)«).  (5.11) 

Now,  using  (2.20)  it  follows  that 

^min  ((So  +  AS)/c)  ^  ^mjn(-®0^)  ^max  (ABk) 

>  C^min(Bo/c)  -  (mpK,)<7n,ax(AB)  (5.12) 

>  O^min(BoK)  -  (mp /Ci)||  AB||f. 


Since  crniin((Bo  +  AB)k)  >  0,  (5.11),  (5.12),  and  (5.6)  yield 

min  ^Aniin[F(B2,yw)  +  F"(ir2,ya;)]  >  [5((T„in(Bo/c) -(maxK,)||AB||F)]  .  (5.13) 

HieUi  2  <■  *  J 

It  now  follows  from  (5.6),  (5.8),  and  (5.12)  that 
min  iA„i„ 

HeH  2 

>  min2(Co,Jk  -  ACjfc)(f^o,fe  -  Afl*)  (5-14) 

k 

+  [5(o’niin(Fo«)  -  (mpK,)l|^||F)]  • 


Once  again  using  Lemma  2.8,  it  follows  that 

Amin  [j$"^  (Hi ,  yw)  -  (Hi,  ju;)+  3F(H2  ,  yw)  -  jF^((H2 ,  jw)] 

>  Amin[l^"^(^^l,;t^)  -  +  Amin  [3F(H2,3<^)  “  jw)] . 

Now,  noting 

3^~'^(Hi,3U})- 3^~^ (Hi, 3u)  =  2diag{-n|  -i^}k=i  > 


(5.15) 


(5.16) 
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we  obtain 


min  ^Aniin[j<^  =  min-(ftfc  -  -  a;. 

Furthermore, 

yields 

”“-?T  \^rainljF{H2,3Uj)-jF^(H2,JU})]  =0. 

HjeHj  2 

It  now  follows  from  (5.15),  (5.17),  and  (5.19)  that 

min  ^A^in  -  j?#-"(ffi,  jo;)  +  3F{H2,3u)  -  jF»{H2,3<^)] 

HeH  2 

>  min  — (flfc  —  AClk)^  —  a>. 

k  U) 


(5.17) 


(5.18) 


(5.19) 


(6.20) 


Similarly, 

min  \  Amin  [j^~^(ifi ,  jw)  -  (fTi ,  ;a>)  +  jF"(i72 , 3^^)  -  3F{H2 , 3^ 

HeH  2 

>  mina;  —  — (fljk  +  Afijk)^. 

~  k  U} 

The  following  theorem  is  now  immediate  using  (3.30)  with  (5.14),  (5.20),  and  (5.21). 

Theorem  5.1.  If  F(H2,s)  is  given  by  (5.5)  then  p(jai)  satisfying  Theorems  3.1  and 
4.1  is  given  by 

p{ju>)  =  max|mm2(Co,jfc  -  ACit)(fio,fc  -  Afifc) 

+  [«5(amin(jBoK)  -  (mp/c)|lAB||F)]  ,  (5.22) 

min  — (fijfc  —  Afijfe)^  —  w,  mina;  —  — (ftjb  +  Afijfc)^  1, 

k  UJ  k  ijJ  ) 

and  Fd(H2,30j)  is  given  by 

m 

Fi{H2,3^)  =  diagj^  (5-23) 

;=i 


)i 

(5.21) 
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Furthermore,  the  (ij)  element  of  Fod{H2,juf)  is  given  by 


1=1 


(5.24) 


Using  (5.23)  and  (5.24)  and  following  a  similar  procedure  used  to  develop  Theorem 
5.1,  we  obtain  the  following  result. 

Theorem  5.2.  Let  F{H2,s)  be  given  by  (5.5)  then  P(jio)  satisfying  Theorem  4.2  is 
given  by 

P{ju)  =  diag{pjtife(ju;) }  ^ ,  (5.25) 


where 


PkkijL^)  =  max|2(Co,fc  -  ACjfc)(fto,fc  -  AO*) 

[<5((6fci  —  ^Bkj)Kj) 
ini— fit  —  w| 


}=i  '■ 


(5.26) 


mini  — 
neo'a; 


In  addition,  the  {i,j)  element  of  Fod{j<^)  satisfying  (4.14)  of  Theorem  4.2  is  given  by 


[KdCju.)] . .  =  +  AB„)«|(|B„,„|  +  ABi,).  (5.27) 

i=l 


6.  Extensions  to  Dynamic  Compensation 

In  this  section  we  generalize  the  results  of  Section  5  to  dynamic  compensation.  Once 
again  we  zissume  colocated  rate  feedback  with  negligible  sensor  and  actuator  dynamics  so 
that  (5.1)  and  (5.2)  hold.  The  following  two  theorems  provide  performance  bounds  for 
positive  real  systems  controlled  by  strictly  positive  real  dynamic  compensators. 

Theorem  6.1.  If  F(H2,s)  =  BK{s)B'^  then  p(ja;)  satisfying  Theorems  3.1  and  4.1 
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is  given  by 

p(ju})  =mcix|inin2(Co,ifc  —  ^Ck){^o,k  —  Afijt) 

+  ^|5(amin(.BoM(ja»)) -amax(M0a;))||A5|lF)  , 

inin(i(fio,ik  -  Afijfef  -w)  -  :Jamax(-K’0‘^)  -  Ji^"0w))(<7max(5o)  +  |1A5||F)^ 

min(a;  —  — (fio.Jfc  +  Afijt)^)  —  ^c’'max(-K’0‘^)  —  {ju))[crmsix(Bo)  +  ||AB||f)  1, 

(6.1) 

where 

K{3u^)  +  =  M(jw)M^(jw).  (6.2) 

Proof.  From  (5.7)  and  (5.9)  we  have 

min  ^Aniin[^''^(-^fi)J‘<^)  +  F'{H2,3U))  +  +  F^{H2,ju})] 

H€H  ^ 

>  mm2(Co,ifc  -  ACjfc)(fio,fc  -  Afijt)  (6.3) 

+  min  l\r.in[F(H2,jcv)  +  F»{H2,ju)]. 

Next,  note  that 

(6.4) 

=  +  AB)M(]W)). 

Now,  using  (2.20)  it  follows  that 

+  AB)M)  >  <7mm{BoM(ju))  -  <7inax(ABM(jw)), 

^  ^min  (BoMiju)) 

^max  (M(ja>))  ^max  (AB),  (6.5) 

^max  (M(;w))||AB||f. 

Noting  that  am\n{BM(ju}))  >  0,  (6.4),  (6.5),  and  (5.6)  yield 

min  lXmin[FiH2,ji^)  +  F^{H2,joj)] 

^  (R 

-  r  _  *12  (6-6) 

>  5  U(cr„i„(B„M(ja.))  -  <t„„(M(jw))||AB||f)  . 
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It  now  follows  from  (6.3)  and  (6.6)  that 

min  ^Anii„[$“^(fri, jw)  +  F{H2,JU))  +  +  F^(ff2,ja;)] 

H€H  ^ 

>  min2(Co,A:  -  ^Ck)i^o,k  -  Afifc)  (6.7) 

k 

+  ^  j^5(<rniin(-BoM(ja;))  -  <7max(M(ja;))||AS||F)j  . 


Similarly,  using  (5.15)  and  (5.17)  we  obtain 

min  ^Amin[;#"^(fri,jw)  -  +  jF(H2,3(jj)  -  jF^{H2,joj)] 

H€H  2 

>  min— (Qo.ifc  -  Afljt)^  -  a;  +  min  -  An,in[X-^(-^2,7‘^)  “  ■^’^(•^^2,7^))]. 

*  w  ^  HieHi  2 


(6.8) 


Hence, 


>  -|(a„ax(Bo)  +  I|aB||f)V„„(b:0u.)  -  jr"0u.)). 

(6.9) 


Finally  using  (6.8)  and  (6.9)  it  follows  that 


niin  JC.')  -  -  F«(H2,j,^))] 

HqJi  2 

>  mini(fio,fc  ~  AQfc)^  —  o)  (6.10) 

ku 

-  -  K^(jU^)){<7mUBo)  +  ||^1|f)". 


Using  a  similar  procedure  given  above  we  obtain 

min  -  f(^2,jw))l 

HeH  2 

>  min  u>  —  —  (flo.Jfc  +  Afl^)^  (®*11) 

k  U) 
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Hence,  using  (6.7),  (6.10),  and  (6.11)  and  Theorem  3.1  the  theorem  is  proved.  □ 

The  next  theorem  gives  the  second  performance  bound  for  the  dynamic  compenstor 
case.  Using  Theorem  4.2  and  a  procedure  similar  to  the  one  employed  in  the  previous 
theorem,  the  following  result  is  immediate. 

Theorem  6.2.  Let  F(H2,s)  =  BK(s)B'^.  Then  P(ju})  satisfying  Theorem  4.2  is 
given  by 

P(jaj)  =  diag{p*jk(;w)}*=i,  (6-12) 


where 

Pkk{j^)  =  max|2(Co,ik  -  AC^)(Q,o,k  -  Aft*) 


I 


-  m 

+  +  -  AB.,)]  , 


1-1 


mm 


—  Ca) 


iV 


1  ^  ^ 
-  -  a:«0u.))^[|b„,kI  +  ABi,]"|. 


(6.13) 


In  addition,  Foi(juj)  satisfying  (4.14)  is  given  by 

m  ^ ^  1  m  _ _ ^  j 

E(|B<,,rt|  +  ABj*)^  ^  [ J](|B„,ii|  +  AB,t)^]  ^  (6,14) 


kz=l 


k=l 


Remark  6.1.  Note  that  in  general  the  performance  bounds  given  by  Theorems  6.1 
and  6.2  are  more  conservative  than  the  bounds  given  by  Theorems  5.1  and  5.2  since  they 
do  not  exploit  the  diagonal  structure  of  the  controller  assumed  in  Section  5. 


Although  there  is  no  general  theory  yet  available  for  designing  positive  real  dynamic 
compensators,  a  variety  of  techniques  have  been  proposed  based  on  theory  [31-38] 
and  Hoo  theory  [38-40].  Next,  for  completeness,  we  present  a  systematic  approach  for 
designing  strictly  positive  real  dynamic  compensators  for  positive  real  plants.  Specifically, 
for  simplicity  we  restrict  our  attention  to  flexible  structures  with  riu  force  inputs  and 
Uu  velocity  measurements  so  that  the  colocated  admittance,  or  driving  point  mobility,  is 
characterized  by 

Mq{t)  +  Cq{t)  -t-  Kq{t)  =  Bu{i),  (6.15) 
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y(t)  =  B'^q(t), 


(6,16) 


where  M,  C,  and  K  are  mass,  damping,  and  stiifness  matrices,  respectively,  and  B  is 
determined  by  the  sensor /aetuator  location.  In  this  case  the  state  space  realization  of 
(6.15)  and  (6.16)  is  given  by 


G(5)~ 


0  I 

-M-^K  -M-^C 

0 

JVf-iB 

L  [0  BT] 

0  J 

0 


(6.17) 


Note  that  under  the  assumption  of  proportional  deimping  the  vibrational  model  in  (6.15) 
and  (6.16)  can  always  be  transformed  into  the  form  of  (3.1).  Finally,  with  G{s)  given  by 
(6.17)  it  follows  that  (2.23)  and  (2.24)  are  satisfied  by  [35,38] 


Qo  = 


K-^ 

0 


0 

M-^  ’ 


L  = 


0 

V2M-'^C\  ’ 


(6.18) 


Next,  we  recast  (3.1)  in  a  state-space  form  and  address  the  strict  positive  real  controller 
synthesis  problem.  Specifically,  given  the  2n***-order  minimal  positive  real  plant 


x{t)  =  Ax{t)  -f-  Bu{t)  -h 
y{i)  =  Cx{i)  ■\-  D2w{i), 

we  seek  to  determine  a  2n*^-order  dynamic  compensator  —K{s)  ~ 
the  form 

Xc{t)  =  AcXc{t)  -I-  Bcvit), 

u(t)  =  -CcXc(t), 


(6.19) 

(6.20) 


(6.21) 

(6.22) 


that  satisfies  the  following  design  criteria: 


(t)  the  closed-loop  system  (6.19)-(6.22)  given  by  = 
stable; 


A 

Bed 


-BCe 

Ac 


is  asymptotically 


(ii)  the  Ha  performance  measure 

1 

J(Ae,Bc,Cc)=  lim  -  /  [a:’^(s)J?ia;(s) -f  ti'^(s)B2u(s)]ds  (6.23) 

t—^oo  t  Jq 


21 


is  minimized,  where  Ri  >  0,  i?2  >  0;  and 


(in)  -K(s) 


Be 


is  strictly  positive  real. 


Note  that  since  the  plant  is  positive  real  and  the  negative  feedback  compensator  is 
strictly  positive  real,  condition  (i)  is  automatically  satisfied.  Now,  using  the  approach 
proposed  in  [34,38]  we  have  the  following  result  for  constructing  strictly  positive  real  com¬ 
pensators.  For  convenience,  define  Vi  =  DiDj  and  V2  =  D2D2  • 

\  A  jB  1 

Theorem  6.3.(34,38).  Assume  G{s)  - 1 - ^  is  positive  real,  and  let  Qo 

and  L  satisfy  (2.23)  and  (2.24)  where  Qo  is  positive  definite.  Furthermore,  assume  that 
there  exist  2n  x  2n  nonnegative-definite  matrices  Q  and  P  satisfying 


0  =  AQ  +  QA^  +Vi-  QC'^V^-^CQ, 

(6.24) 

0  =  A^P  +  PA  +  R1-  PBR^^B'^P, 

(6.25) 

where  JZi ,  R2,  Vi ,  and  V2  satisfy 

Vi=LL^  +  BR^^B'^  >0, 

(6.26) 

II 

(6.27) 

i?i  >  C'^R^^C. 

(6.28) 

Then  the  negative  feedback  compensator 
-K{s)  - 


Ac 

Be  1 

A-QC'^V^-^C-BR^^B'^P 

-Cc 

0 

R^^B^P 

0 

(6.29) 

is  strictly  positive  real  and  satisfies  the  design  criteria  (i),  (it).  Furthermore,  the  H2 
performance  is  given  by 


J{Ae,Be,Cc)  =  tr[Qili  +  QC'^Vi'^CQP]. 


(6.30) 


In  order  to  compare  the  positive  real  majorant  bounds  developed  in  this  and  the 
previous  section  to  the  complex  block-structured  majorant  bound  [7]  and  the  complex 
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structured  singular  value  bound  [41],  next  we  provide  a  synopsis  of  the  results  developed 
in  [7]  and  [41]. 


7.  The  Complex  Block-Structured  Majorant  Bound  and  the  Complex  Struc¬ 
tured  Singular  Value  Bound 

In  this  section  we  present  a  brief  summary  of  the  results  from  [7]  involving  the  complex 
block-structured  majorant  bound  and  [1,41]  involving  the  complex  structured  singular 
value  bound.  Consider  the  standard  problem  of  a  linear  time-invariant  dynamic  system 
given  by 


z(s)  =  Gn(5)M^)  +  G'i2(5)«(s), 

(7.1) 

y(s)  =  G2i{s)w{s)  -f  G22{s)u(s), 

(7.2) 

u{s)  =  As(s)y{s), 

(7.3) 

where 

As{s)  €  As  =  {As  :  As(ju>)  <<  As(juj)}. 

(7.4) 

Note  that  (7.1)-(7.3)  can  be  written  as 

z(s)  =  G(s)w{s), 

(7.5) 

w(s)  =  A(s)z(s)  -t-  u(s). 

(7.6) 

where 

.  A  [^(s)]  A  [10(5)1  -/  X  A  [10(5) 

^W  =  [j,w]’  "’<")=[«(»)]’  •'W=[  0  . 

The  system  given  by  (7.5)  and  (7.6)  could,  for  example,  represent  an  uncertain  system 
in  a  closed-loop  configuration  with  the  plant  uncertainty  As  “pulled  out”  into  a  fictitious 
feedback  loop  as  shown  in  Figure  1. 


Next,  we  present  a  theorem  which  provides  the  complex  block-structured  majorant 
bound  along  with  a  robust  stability  condition  for  the  linear  time-invariant  system  (7.5) 
and  (7.6). 
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Theorem  7.1. [7].  The  feedback  system  given  by  (7.5)  and  (7.6)  is  robustly  stable  for 
all  As  €  As  if 

/o[|(?(ju;)|mA(jw)]  <1,  u?  €  (0,  oo).  (7.7) 

Furthermore,  the  output  z(ju;)  satisfies  the  bound 

\K3‘^)\u  <<  [I-  |G(ja;)|MA(ja;)]-^ |G(ja;)u(ja;)|j^,  (7.8) 


where 


A{ju)  ^ 


0 

0 


^  0 

Asijuj) , 


Next,  we  summarize  the  method  for  obtaining  the  complex  structured  singular  value 
bound  [41]  for  the  standard  problem  addressed  by  (7.1)-(7.3).  First  recall  that  for  complex 
multiple  block-structured  uncertainty  As  G  Abs?  where 


Abs  =  {As  :  As  =  block-diag(Ai ,  A2,  •  •  • ,  Ar),  Aj  €  C 


m,*  Xm; 


=  l,-..,r},  (7.9) 


and  where  are  given,  the  complex  structured  singular  value  A‘Aba(^(.?‘^))  is 

defined  by 

/^Ab.(G'(j^))  =  {<7max(As) :  det(J  -  G(ju})As)  =  0})“\  (7.10) 

Aa€Abs 

while  =  0  if  there  exists  no  As  €  Abs  such  that  det(/  —  G(ju})As)  =  0.  It  has 

been  shown  [1,41]  that  satisfies  the  inequality 

MAb.(G(ja;))  <  inf  (rm^x{N{3u)G(ju)N-\joj)),  (7.11) 

Ar(ju;)€A^Abs 

where  A^bs  denotes  the  set  of  positive-definite  scaling  matrices  which  are  compatible  with 
the  uncertainty  structure  Abs-  Recall  that  if  the  number  of  blocks  in  As  is  three  or  less 
then  the  inequality  in  (7.11)  is  a  strict  equality  [41]. 

As  is  well  known  [1,2,41],  in  order  to  consider  robust  performance  within  the  complex 
structured  singular  value  framework  involving  the  standard  problem  given  by  (7.1)-(7.3), 
we  introduce  an  additional  uncertainty  block  Ap  between  w  and  z  so  that 

u;(s)  =  Ap(s)z{s)  (7.12) 
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and  require  stability  robustness  in  the  face  of  all  perturbations,  including  the  fictitious 
block  Ap.  In  this  case,  (7.1)-(7.3)  along  with  (7.12)  can  be  written  as 


z(s)  =  G(s)w{s), 

(7.13) 

w{s)  =  A(s)f(s), 

(7.14) 

[  0  Ag(s)J- 

(7.16) 

where 


This  feedback  configuration  can  be  captured  by  Figure  1  by  setting  v  to  zero  and  replacing 
A(s)  by  A(s).  Finally,  note  that  the  output  z(s)  is  related  to  the  input  w(s)  by 


■2(5)  =  0(s)w(s), 


(7.16) 


where 

e(s)  =  [G„(»)  +  G,2(s)A.(s)[/  -  G22(s)A.(«)]-‘G2,(<i)]. 

For  the  statement  of  the  next  result  define 

A  =  {A  :  A  =  block-diag(Ap,  Ag),  and  Ag  €  Abs}) 

BAb,  =  {^s  :  ||Asl|oo  <  -  and  Ag  €  Abs}, 

7 

Ba  4  {A  €  A  :  ||A|U  <  i}. 

Theorem  7.2.  Let  A  €  Ba-  Then  the  feedback  system  given  by  (7.13)  and  (7.14)  is 
robustly  stable  for  all  Ag  €  Abs  if  and  only  if 

/iAb.(<?22(jw))  <7,  io€  (0,oo).  (7.17) 

Furthermore,  if  //Ab,(^22(jw))  <  <  7  then 

W^Mh  < /^A(G'(ja;))||tt;(jw)||2.  (7.18) 


Proof.  The  first  part  of  the  theorem  involving  robust  stability  is  a  direct  consequence 
of  Theorem  4.2  of  [41].  Now,  to  show  the  performance  bound  (7.18)  let  /xa(G^(jw))  =  /?  <  7, 
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so  that  det(J  -  G{ju})A)  7^  0  for  all  ||A||oo  <  Furthermore  if  A«Ab.(C’220‘<^))  <  then 
det(/  -  G220t‘')As)  7^  0  for  all  ||A||oo  <  Now,  since  det(/  -  Gijuj)A)  =  det(/  - 
G220‘^)As)det(/  -  G(ju>)Ap),  it  follows  that  det(/  -  Q{ju)Ap)  7^  0,  for  aJl  ||A|loo  < 
Hence, 

Furthermore,  note  that 


m^  fiApiQ{j^))<  , /^Ap(^Ow)). 

AsEBAba  Aa€Aba,!l Ajloo 

Now,  using  (7.16)  the  performance  bound  (7.18)  is  immediate.  □ 

Remark  7.1.  Note  that  if,  alternatively,  fi^{G(ju^))  <  /UAba(^^22(jt^))  <  7  is  satisfied 
in  the  statement  of  Theorem  7.2  then  (7.18)  can  be  replaced  by 


\z{juj)h  <  A<Ab,(G'22(l‘^))||u)(ja;)||2. 


Since  our  uncertainty  characterization  considered  in  Section  3  is  in  the  time  domain, 
we  briefly  outline  a  systematic  approach  to  converting  this  uncertainty  into  the  transfer 
function  presented  by  the  standard  problem  representation  in  (7.1)-(7.3).  First,  recall  that 
an  uncertain  state-space  model  with  disturbance  Dw{t)  and  performance  variables  Ex{t) 
can  be  viewed  as  a  system  in  a  feedback  configuration  with  the  gain  Ag  (see  Figure  1), 
that  is. 


x{t)  =  Ax{t)  -h  Bou(t)  +  Dw(t),  (7.19) 

y{t)  =  Cox(<),  (7.20) 


with  feedback 

u{t)  =  Asy(t), 


and  performance  variables 


z(t)  =  Ex{t). 


(7.21) 


(7.22) 
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Note  that  Bo  and  Co  in  this  formulation  are  fixed  matrices  denoting  the  structure  of  the 
uncertainty.  Now,  it  follows  that  (7.19)-(7.22)  yield 


zis)  =  E{sl  -  A)-^Dw{s)  +  E{sl  -  Bou{s),  (7.23) 

y{s)  =  Co{sI  -  A)-'^Dw(s)  +  Co(sI  -  A)-'^Bou{s),  (7.24) 

u{s)  =  A,{s)yis),  (7.25) 


which  are  equivalent  in  form  to  the  standard  problem  equations  given  by  (7.1)-(7.3).  Now, 
with  frequency  and  damping  uncertainty,  the  system  matrix  in  (3.1)  can  be  Written  in 
second  order  canonical  form  A  =  block-'diag(i4,'),  z  =  1,  •  •  • ,  n,  where 


Ai 


0  1 
-n?  -2c.aJ’ 


or,  equivalently. 


0 

1 

+ 

0  o' 

^‘0,« 

.7.'  ^i. 

i  =  l,-*-,n. 


where  flo.i  and  Co,i  are  the  nominal  natural  frequencies  and  damping  coefficients  respec¬ 
tively,  7i  is  the  imcertainty  in  and  e,-  is  the  uncertainty  in  2CiQ.i.  Now,  in  order  to  use 
the  above  framework  it  need  only  be  noted  that 


ro  oi 

0  o' 

o 

_ J 

1  o' 

1  1 

o 

1 _ 

0  1 

Of  course,  the  above  analysis  also  holds  for  a  nominal  closed-loop  system  with  feedback 
uncertainty.  In  this  case  however,  appropriate  modifications  to  the  system  matrices  in 
(7.23)  and  (7.24)  axe  needed  to  capture  the  nominal  closed-loop  dynamics. 


8.  Illustrative  Numerical  Examples 


In  this  section  we  present  several  illustrative  numerical  examples  that  demonstrate 
the  effectiveness  of  the  proposed  positive  real  majorant  bounds  (PRMB)  over  the  complex 
block-structured  majorant  bound  (CBSMB)  and  the  complex  structured  singular  value 
bound  (CSSVB). 

Example  8.1.  (n  =  1,  damping  uncertainty) 
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Our  first  example  considers  performance  bounding  for  the  case  n  =  1  with  one  control 

input  and  damping  uncertainty.  The  closed-loop  system  is  given  by  (3.26)  with 

*-1^77  N  5^  H- -f- 

$  \Hi,s)  = - , 

s 

FiH2,s)  =  hb\ 


ki  =2,  D  =  b  =  1, 


and  with 

f2  =  10(27r) — ,  C  =  0.01,  AC  =  0.009. 
sec 

In  this  case,  Theorems  4.1  and  4.2  give  the  same  performance  bound  which  is  shown  in 
Figure  2.  For  this  example,  the  complex  block-structured  majorant  bound  is  totally  non¬ 
conservative  while  the  complex  structured  singular  value  bound  gives  the  most  conservative 
performance  predictions. 


Example  8.2.  (n  =  1,  frequency  uncertainty) 


This  example  considers  the  same  case  as  Example  8.1  except  that  the  damping  ratio 
is  constant  while  the  frequency  is  uncertain  with 

^  =  5(27r)— . 

sec 

For  the  assumed  uncertainty  range  both  the  complex  block-structured  majorant  bound 
and  the  complex  singular  value  bound  are  infinite  since,  in  this  case,  both  methods  predict 
instability.  The  proposed  positive  real  majorant  bound  gives  a  tight  finite  performance 
bound.  This  is  shown  in  Figure  3. 


Example  8.3.  (n  =  3,  frequency  uncertainty  in  the  first  mode) 

This  example  considers  performance  bounds  for  three  closely  spaced  modes  with  one 
control  input  and  frequency  uncertainty  in  the  first  mode.  The  closed-loop  system  is  given 
by  (3.26)  with 


$-'(ifi,s)  =  diag{ 


+  2CiQiS  -1- 


}Li, 


D  =  B, 

fci  =  2,  B  =  [l,lAf, 
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Eind  with  ,  ,  , 

T'flri  T/io  rji  fi 

{^1,^2, ^3}  =  {10(2’^)— ,15(27r)— ,50(2?r)— }, 

sec  sec  sec 

{Ci,C2,C3}  =  {0.005,0.01,0.0025}, 

{Afti,  Afta,  Afia)  =  {5(27r) — ,0,0}. 

sec 

Once  again  both  the  complex  block-structvired  majorant  bound  and  the  complex  structured 
singular  value  bound  give  infinite  performance  predictions.  The  positive  real  majorant 
boimd  shown  in  Figure  4  gives  a  finite  performance  bound.  This  boimd  was  obtained  by- 
computing  the  minimum  of  the  performance  botmds  given  by  Theorems  5.1  and  5.2  for 
each  frequency. 

Example  8.4.  (n=3,  frequency  and  mode  shape  uncertainty) 

In  order  to  compare  the  positive  real  majorant  bounds  obteiined  by  Theorems  5.1  and 
5.2  and  Theorems  6.1  and  6.2  this  example  considers  the  same  case  as  Example  8.3  with 
two  sensors  and  actuators  with  both  frequency  and  mode  shape  uncertainty.  Specifically, 
the  frequency  uncertainty  is  as  in  Example  8.3  and  the  mode  shape  uncertainty  with  the 
assumed  static  controller  are 


'1 

r 

'0.01  0.01  ■ 

’2  o' 

1 

1 

1 

1 

,  AB  = 

0.01  0.01 

0.01  0.01 

,  K  = 

0  1 

The  corresponding  bounds  are  shown  in  Figure  5.  Note  that  since  the  assumed  frequency 
range  for  this  example  is  the  same  as  the  previous  example  the  bounds  of  Section  7  do  not 
give  finite  predictions. 

Next,  using  the  frequency  domain  performance  boimds  given  by  Theorems  6.1  and 
6.2  along  with  Theorem  6.3  for  constructing  strictly  positive  real  dynamic  compensators 
we  apply  our  results  to  a  simply  supported  Euler-Bernoulli  beam  with  multiple  frequency 
uncertainty. 


Example  8.5.  Consider  the  simply  supported  Euler-Bernoulli  beam  with  governing 
partial  differential  equation  for  the  transverse  deflection  w{x,t)  given  by 


d^w{x,t)  d'^  d^w{x,t)  _ 

ru-2  +  ^3.2 


dt^ 


dx^ 


(8.1) 
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and  with  boundary  conditions 


j(a:,<)|r=o,L  =  0,  El 


d'^w{x,t)  I 


t=0,L  =  0, 


where  m(ar)  is  mass  per  unit  length  and  EI{x)  is  the  flexural  rigidity  with  E  denoting 
Young’s  modulus  of  elasticity  and  I{x)  denoting  the  cross-sectional  area  moment  of  inertia 
about  an  axis  normal  to  the  plane  of  vibration  and  passing  through  the  center  of  the 
cross-sectional  area.  Finally,  f{x,  t)  is  the  force  distribution  due  to  control  actuation  and 
external  disturbances.  Assuming  uniform  beam  properties,  the  modal  decomposition  of 
this  system  has  the  form 

OO 

w(x,t)  =  YiWr(x)qr(t),  (8.3) 

r=l 

I  0  TTTX 

mW^{x)dx  =  r  =  l,2, ...,  (8.4) 

where,  assuming  uniform  proportional  damping,  the  modal  coordinates  Qr  satisfy 

9V(t)  +  2COr5r(t)  +  fir9r(0  =  /  fix,t)Wr(x)dx,  r  =  l,2,....  (8.5) 

Jo 


For  simplicity  assume  L  =  tt  and  m  =  El  =  2fn  so  that  y  7;^  =  1-  Furthermore,  we  place 
a  colocated  velocity /force  actuator  pair  at  z  =  0.55L.  Finally,  modeling  the  first  five  modes 
and  defining  the  plant  state  as  z  =  [51,  9a,  •  •  • ,  95,  95]^,  and  defining  the  performance  of 
the  beam  in  terms  of  the  velocity  at  z  =  0.7L,  the  resulting  state  space  model  and  problem 


data  are 


A  =  block-diag  ^ 


B  =  C'^  =  [Q  0.9877  0  -0.309  0  -0.891  0  0.5878  0  0.7071]^, 
fO  0.809  0  -0.951  0  0.309  0  0.5878  0  -l‘ 

■^^“[0  0  0  0  0  0  0  0  ooj’ 

E2  =  [Q  1.9]'^,  i?i  =  F?'Fi,  Di  =  \B  Oioxi],  I?2  =  [0  1.9], 

V2  =  R2=  D2DI  =  E'^E2  =  3.61. 


Using  Thoerem  6.3  we  design  a  strictly  positive  real  dynamic  compensator  K{s).  Next, 
we  assume  frequency  uncertainty  in  both  Qi  and  Q2  with  Afli  =  0.5  and  AQ2  =  0.5.  The 
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corresponding  positive  real  majorant  performance  bound  is  given  in  Figure  6.  Once  again 
this  bound  was  obatained  by  computing  the  minimum  of  the  performance  bounds  given 
by  Theorems  6.1  and  6.2  for  each  frequency.  The  complex  block-structured  majorant 
bound  and  the  complex  structured  singular  value  bound  predict  instability  for  the  as¬ 
sumed  uncertainty  range  and  hence  give  infinite  performance  bounds.  In  order  to  compare 
the  performance  boimds  using  all  three  methods,  the  maximum  uncertainty  range  in  the 
natural  frequencies  for  which  the  two  alternative  methods  guarantee  stability  is  foimd. 
Specifically,  complex  structured  singular  value  analysis  predicts  stability  for  the  range  of 
Afli  <  0.034  and  Af22  <  0.134,  while  complex  block-structured  majorant  analysis  pre¬ 
dicts  stability  for  the  range  of  Afli  <  0.071  and  An2  <  0.144.  The  parameter  space  for 
the  above  predictions  is  shown  in  Figure  7.  Note  that  the  positive  real  result  guarantees 
unconditional  stability.  Now,  with  Afli  =  0.034  and  Afl2  =  0.134  which  coressponds 
to  the  largest  uncertainty  range  for  which  all  three  robustness  tests  guarantee  stability, 
the  comparision  of  the  performance  bounds  for  all  three  approaches  is  shown  in  Figure  8. 
Note  that  the  proposed  positive  real  majorant  bound  gives  the  tightest  robust  performance 
bound  while  the  complex  structured  singular  value  bound  (/x-performance  bound)  is  the 
most  conservative. 

9.  Conclusion 

This  paper  developed  frequency  domain  performance  bounds  for  closed-loop  systems 
consisting  of  positive  real  plants  and  strictly  positive  real  compensators.  The  results  are 
developed  by  using  certain  properties  of  the  logarithmic  norm  in  conjunction  with  ma¬ 
jorant  analysis.  Unlike  previous  results  in  robustness  analysis,  the  performance  bounds 
remain  finite  even  when  the  imcertainty  is  made  large.  The  examples  compared  the  new 
bounds  with  a  previous  majorant  bound  and  the  corresponding  bound  from  complex  struc¬ 
tured  singular  value  analysis.  In  all  cases  the  new  bound  was  much  less  conservative  than 
the  alternative  bounds.  Ffrture  work  will  involve  extending  these  results  to  reduce  the 
conservatism  in  the  analysis  of  closed-loop  systems  for  which  the  plant  and  controller  are 
positive  real  only  over  a  particular  frequency  band. 
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Figure  1.  Nominal  Closed-Loop  with  Feedback  Uncertainty 
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Figure  2.  Performance  Bounds  for  Example  8.1  (n=l,  Damping  Uncertainty) 


Example  8.2:  ftequency  Uncertainty  (Delta_Omega=5Hz) 
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Figure  3.  Performance  Bound  for  Example  8.2  (n=l.  Frequency  Uncertainty) 
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Example  8.3:  Three  Modes  with  5Hz  Uncertainty 
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Figure  4.  Performance  Bound  for  Example  8.3  (n=3,  Frequency  Uncertainty) 
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Example  8.4:  Mode  Shape  Uncertainty 


Frequency  Hz 


Figure  5.  Comparision  of  Performance  Bounds  Obtained  from 
Theorems  5.1  and  5.2  and  Theorems  6.1  and  6.2 
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Figure  6.  Performance  Bound  for  the  Euler-Bemoulli  Beam  (Example  8.5) 
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Abstract 


Robust  performance  analysis  is  very  important  in  the  design  of  controllers  for  uncertain 
multivariable  systems.  Recent  research  has  investigated  the  use  of  absolute  stability  criteria 
to  develop  less  conservative  analysis  tests  for  systems  with  linear  and  nonlinear  real  param¬ 
eter  uncertainties.  This  paper  extend  previous  work  on  optimal  Hi  performance  analysis 
with  the  Popov  criterion.  In  particular,  an  algorithm  is  presented  that  can  be  used  to  ana¬ 
lyze  systems  with  multiple  uncertainties  that  have  both  upper  and  lower  robustness  bounds. 
More  general  Popov  stability  multipliers  and  less  restrictive  assumptions  on  the  structure 
of  the  uncertainty  block  are  also  included.  The  analysis  is  performed  using  a  numerical  ho- 
motopy  algorithm.  The  technique  is  demonstrated  on  robust  compensators  that  have  been 
designed  for  the  Middeck  Active  Control  Experiment  (MACE):  a  Shuttle  program  scheduled 
for  flight  in  December,  1994.  The  analysis  clearly  shows  the  relative  robustness  capabilities 
of  the  robust  controllers  used  in  the  iterative  control  design  methodology  that  has  been  de¬ 
veloped  for  the  uncertain  dynamics  of  MACE.  The  analysis  is  also  combined  with  Popov 
controller  synthesis  to  yield  a  more  sophisticated  design  technique  for  compensators  that 
provide  guaranteed  robust  performance. 
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The  Popov  analysis  and  synthesis  algorithms  have  been  developed  from  research  on  the 
Popov  stability  criterion  [12]  from  absolute  stability  theory  [11,13—17].  The  absolute  stability 
criteria  provide  sufficient  conditions  for  the  stability  of  a  system  in  feedback  with  a  particular 
class  of  sector-bounded,  static  nonlinear  functions  [12,17].  Note  that  a  class  of  nonlinear 
functions  can  be  associated  with  a  set  of  system  uncertainties  considered  in  robust  control. 
Thus,  the  Popov  controller  synthesis  approach  to  robust  control  directly  considers  nonlinear 
real  parameter  uncertainties  and  treats  linear  uncertainties  as  a  subset  of  this  much  broader 
class. 

The  state  space  tests  from  absolute  stability  theory  with  Lur’e-Postnikov  Lyapunov  func¬ 
tions  are  well  documented  [17],  but  it  is  only  recently  that  the  significance  of  the  parameter¬ 
ized  Lyapunov  functions  for  robust  control,  in  terms  of  a  restriction  on  the  time  variation  of 
the  uncertainty  set,  has  been  understood  [11,15,14,18].  A  frequency  domain  representation 
of  the  absolute  stability  criteria  is  used  in  Refs.  [19,14,18,17,20]  to  demonstrate  that  the 
robustness  tests  include  magnitude  and  phase  information  about  the  system  uncertainties. 
Both  characteristics  of  the  uncertainty  must  be  considered  to  develop  nonconservative  tests 
for  a  system  with  real  parameter  uncertainty  that  is  restricted  to  have  phase  of  ±180°. 

The  primary  purpose  of  this  paper  is  to  present  several  advances  in  Popov  controller 
analysis  and  synthesis.  Examples  in  Ref.  [21]  illustrate  that  the  state  space  Popov  analysis 
criterion  is  much  less  conservative  than  similar  positive  real  and  small  gain  (Tioo)  criteria. 
This  paper  extends  these  previous  results  by  considering  systems  with  multiple  uncertainties 
that  have  both  upper  and  lower  sector-bounds.  The  stability  criterion  is  also  developed  using 
a  more  general  stability  multiplier 

W{s)  =  H  +  Ns,  (1) 

where  N  >0,  and  if  >  0  is  not  restricted  to  be  the  identity  matrix,  as  required  in  Ref.  [21]. 
Furthermore,  the  algorithm  is  developed  with  fewer  restrictions  on  the  structure  of  the  system 
uncertainty. 

The  optimal  Popov  analysis  algorithm  is  demonstrated  using  several  robust  controllers 
that  were  designed  using  a  finite  element  model  of  MACE  [2,22].  The  results  clearly  show 
the  relative  robustness  capabilities  of  the  various  techniques,  and  thus  further  illustrate 
their  role  in  the  iterative  control  design  methodology  discussed  earlier.  The  best  of  these 
controllers  was  refined  using  the  optimal  Popov  controller  synthesis  algorithm  developed 
in  Ref.  [11,19,23].  Together,  the  two  algorithms  combine  an  improved  analysis  capability  with 
a  synthesis  technique  that  guarantees  robust  performajice  for  systems  with  real  parameter 
uncertainty.  In  the  process,  this  combination  overcomes  one  of  the  main  difficulties  wnth 
the  original  synthesis  algorithm:  developing  the  stability  multipliers  for  large  guaranteed 
stability  bounds  [11,19]. 
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have  both  upper  and  lower  sector-bounds.  The  structure  of  these  uncertainties  is  also  made 
less  restrictive  by  removing  the  assumption  that  CqBq  =  0.  This  section  provides  an  outline 
of  the  homotopy  algorithm,  and  an  exeimple  of  the  approach  is  presented  in  the  last  section. 


For  clarity,  the  cost  in  Theorem  1  is  rewritten  here  as 

7  =  itr  [(P  +  CI{M2  -  M^)NCo)V„] ,  (16) 

where  P  is  the  solution  of 

0  =  A^P  -f  PAm  +  (c-  -  BlP)  +  aP,„  (17) 

and 

A^kA-BoM,Co,  (18) 

C^HCoA  NCoAm,  (19) 

Crioc^C-B^P,  (20) 

Ai  i  -  BoRo'C,  (21) 

A2^Am-BoR^^C,icc.  (22) 

Note  that,  with  these  definitions,  Eq.  17  can  be  rewritten  in  the  more  familiar  form 

0  =  Af  P  +  PAi  +  +  aR^^  +  PPoPq  '  P.  (23) 


The  Lagrangian  (£)  for  the  system  is  then  formed  by  combining  the  cost  overbound  in 
Eq.  16  with  the  constraint  in  Eq.  17  using  Lagrange  multiplier  matrix  Q.  The  derivatives 
of  this  Lagrangian  with  respect  to  the  free  parameters  in  the  design  are  the  first-order 
necessary  conditions  that  must  be  satisfied  to  determine  an  optimal  solution.  In  particular, 
differentiating  with  respect  to  P  yields  a  Lyapunov  equation  for  the  Lagrange  multiplier 
matrix  Q 

0  =  AjQ  +  QAl  +  -14,.  (24) 

a 

Note  that,  if  (•)  refers  to  any  free  parameter  in  the  optimization  process,  then  5£/5(-)  = 
dJ ld{-)  [27].  The  optimization  problem  then  is  to  find  values  of  a,  if,  and  N  that  satisfy 

I?  ^  =  tr  [QP„]  --7=0,  (25) 

oa  a 

=  -(M2  -  M,)CoV,,C^  +  2Po-'C7riccQA[Co"'  =  0,  (26) 

C7iV  a 

i  Pa  =  2R-^CriccQ(Co  -  (Ma  -  MO’^Po '<^ricc)’’  =  0,  (27) 

Oil 

where  P  and  Q  are  the  solutions  of  Eq.  17  and  Eq.  24,  respectively.  Note  that  only  the 
elements  of  H2  and  P3  corresponding  to  free  parameters  in  N  and  H  can  be  set  to  zero  in 
the  optimization  process  [11,15,18]. 
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Note  that  M2(0)  =  M20  and  M2(l)  =  M2/.  The  overall  goal  is  to  solve  the  optimization 
problem  at  A  =  1.  However,  it  is  usually  quite  difEcult  to  develop  valid  initial  conditions 
for  the  optimization  at  this  point.  Thus,  a  starting  point  that  is  simpler  to  initialize  is 
introduced,  and  this  corresponds  to  A  =  0  in  Eq.  33.  The  purpose  of  the  homotopy  procedure 
is  to  obtain  a  solution  to  the  optimization  problem  at  A  =  1  by  starting  at  A  =  0  and 
predicting  the  solution  at  A  +  aA  based  on  the  system  derivatives  amd  the  solution  at  A  [21]. 

The  continuation  map  is  defined  as  the  gradient  of  the  upper  bound  on  the  cost  function 
for  the  homotopy  parameters  Mi  and  M2.  To  compute  this  map,  define 

Ha  (77,  A) 

T(77,A)i  vec;,(H2(7?,A))  .  (34) 

_  vecAr(H3(77,  A))  _ 


Then,  as  indicated  by  Eqs.  25-27,  the  continuation  curve  is  given  by  L{7],  A)  =  0  for  A  G  [0, 1]. 
Then,  taking  both  a  and  6  to  be  functions  of  A,  we  can  differentiate  L{7]{X),  A)  =  0  with 
respect  to  A  to  yield  Davidenko’s  differential  equation  [28,29] 


dri  dA  BX 


(35) 


Together  with  77(0)  =  770,  this  differential  equation  defines  an  initial  value  problem  which,  by 
numerical  integration  from  A  =  0  to  A  =  1,  yields  the  desired  solution  77(1)  (see  Ref.  [26]  for 
further  details).  As  indicated  by  Eq.  35,  the  solution  algorithm  requires  the  computation  of 


the  Jacobian  of  L{a,  6,  A),  which  is  given  by 

11 

> 

(36) 

where 

r  ^8L 

dr,'  BX' 

(37) 

The  expressions  for  these  gradients  are  given  in  the  Appendix.  The  combined  prediction- 
correction  sequence  is  presented  in  Table  1.  The  algorithm  starts  with  a  correction  step  that 
updates  the  initial  guess.  When  this  step  has  converged,  the  value  of  A  is  increased,  and  the 
changes  in  the  multiplier  coefficients  are  predicted  in  step  3d.  The  value  of  A  is  increased 
until  ||I-(a,  ^,A)||  is  larger  than  a  specified  tolerance.  The  predictions  of  the  coefficients  77 
are  then  corrected  in  step  4.  The  cycle  is  repeated  until  A  =  1  or  the  stability  prediction 
limit  is  reached.  The  output  from  the  program  is  a  list  of  optimal  multipliers  and  the  cost 
overbound  at  several  values  of  A,  which  define  the  different  guaranteed  stability  regions. 

The  procedure  in  Table  1  is  initialized  by  finding  a  set  of  scaling  parameters  for  a  given 
controller  so  that  acceptable  solutions  exist  for  Eqs.  17  and  24.  This  step  is  typically  one  of 
the  most  difficult  parts  of  a  gradient  search  algorithm  such  as  the  one  described  in  this  paper. 
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Figure  2:  Middeck  Active  Control  Experiment  (MACE)  EM  test  article  sus¬ 
pended  in  1-g  by  a  three  point  suspension  system. 

ity  active  structural  control  in  zero  gravity  conditions.  The  prediction  of  on-orbit  closed-loop 
dynamics  is  based  on  analysis  and  ground  testing.  The  goal  of  active  control  is  to  maintain 
pointing  accuracy  of  one  payload,  while  the  remaining  payload  is  moving  independently. 
References  [1,2,30]  describe  the  experiment  goals,  hardware,  and  analytical  modelling  in 
some  detail. 

The  configuration  of  the  MACE  test  article  was  chosen  to  be  representative  of  precision 
controlled,  high  payload  mass  fraction  spacecraft,  such  as  Earth  observing  platforms,  with 
multiple,  independently  pointing  or  scanning  payloads  [31].  The  Engineering  Model  (EM) 
is  shown  in  Figure  2.  Note  that  the  X,  Y,  and  Z  axes  are  horizontal,  vertical,  and  into 
the  figure,  respectively.  The  test  article  consists  of  a  flexible  bus  to  which  are  mounted 
two  payloads,  a  reaction  wheel  assembly  for  attitude  control,  and  various  other  sensors  and 
actuators.  Each  payload  is  mounted  to  the  structure  using  a  two-ax;is  gimbal  that  provides 
pointing  capability.  The  EM  is  instrumented  with  angle  encoders  on  each  gimbal  axis,  a 
three  axis  rate  gyro  platform  mounted  under  the  reaction  wheel  assembly,  and  a  two  axis 
rate  gyro  platform  mounted  in  the  primary  payload.  The  bus  is  composed  of  circular  cross- 
section  Lexan'^*^  struts  connected  by  aluminum  nodes.  The  structure  is  supported  for  ground 
tests  by  a  pneumatic/electric  low-frequency  suspension  system  [32]. 

As  discussed  in  Ref.  [2],  several  robust  controllers  were  designed  for  the  MACE  test 
article  using  the  finite  element  model  discussed  in  Refs.  [22,33].  Control  experiments  have 
been  performed  for  the  full  XYZ  dynamics  of  MACE.  However,  for  this  paper,  we  consider 
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For  this  closed-loop  system,  the  cost  function  is  determined  by  the  nonnegative  definite 
matrices  R^x  =  and  K,  =  If  the  uncertainty  in  the  open-loop  system  is 

represented  by  Ao\  +  aAoI,  then  the  model  error  for  the  closed-loop  system  is  written  as 


aAci  = 


aAoi 

OnXric 
On.  xn  On.  XTle 


(46) 


The  nominal  system  dynamics  and  model  error  in  Eq.  42-45  can  then  be  combined  to  write 
the  actual  closed-loop  system  dynamics  in  the  form  of  Eqs.  2  and  3. 

The  advantages  and  disadvantages  of  using  finite  element  models  (FEM)  for  MACE  con¬ 
trol  design  are  discussed  in  Refs.  [2,3,33].  The  primary  advantage  is  that  this  analytical 
modelling  method  can  be  used  to  predict  the  on-orbit  dynamics  prior  to  launch.  However, 
a  key  difficulty  is  that  FEM’s  tend  to  be  much  less  accurate  than  equivalently  sized  mea¬ 
surement  models  [34].  In  particular,  there  tend  to  be  substantial  errors  in  some  modal 
frequencies  and  damping  ratios,  which  is  certainly  true  for  a  complicated  structure  such  as 
MACE.  Note  that,  to  retain  the  capability  of  predicting  the  0-g  dynamics  of  the  MACE 
test  article,  the  measured  Tg  data  is  used  to  update  the  physical  parameters  of  the  test 
article  model,  and  not  just  the  frequency  characteristics  of  a  particular  state  space  model. 
This  update  procedure  is  a  very  difficult  task,  and  is  the  subject  of  ongoing  research  [33]. 
Thus,  the  work  in  Ref.  [2]  used  the  FEM  as  given,  and  no  attempt  was  made  to  update  the 
state  space  model  to  account  for  obvious  damping  or  frequency  errors,  because  this  would 
inconsistent  with  the  purpose  of  the  FEM  in  the  MACE  project  [1]. 

For  a  system  with  many  model  errors,  it  is  important  to  determine  those  that  are  most 
critical  to  the  control  design.  As  discussed  in  Refs.  [2,3],  the  most  important  uncertainties 
to  consider  can  be  determined  using  a  combination  of  analysis  techniques  based  on  the 
singular  values  of  the  sensitivity  function,  the  multivariable  Nichols  test,  and  preliminary 
experiments.  These  techniques  were  used  to  determine  that  the  frequencies  of  three  modes 
were  the  most  important  uncertainties  for  these  control  designs.  Note  that  these  errors 
correspond  to  real  parameter  uncertainties  in  the  system  model. 

The  errors  in  these  three  modes  are  listed  in  Table  2.  The  finite  element  model  results  are 
compared  with  an  identified  model  from  measured  data  [34].  The  “violin”  description  refers 
to  modes  with  substantial  interaction  between  the  test  article  and  the  suspension  system. 
Note  that  experience  from  these  and  other  experiments  has  demonstrated  that  small  errors  in 
the  damping  values  tend  to  degrade  closed-loop  performance,  but  small  errors  in  the  natural 
frequencies  often  lead  to  closed-loop  instability.  Thus,  the  model  errors  considered  here 
address  the  more  important  issue  of  modal  frequency  uncertainty.  For  future  comparison, 
note  that  the  lowest  frequency  mode  of  these  three  was  nearly  destabilized  by  a  very  low 
authority  LQG  design  that  achieved  only  a  4  dB  performance  improvement. 
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Figure  8:  Robust  stability  and  performance  analysis  using  several  controllers  for 
MACE.  Symbols  x  indicate  nominal  Hz  performance  for  each  design. 


perturbation  factor.  The  actual  dynamics  for  each  uncertain  mode  can  be  written  as  Ai  = 
Ai  -|-  where 

,  and  Coi  =  [  a;,-  0  ],  i  =  1, . . . ,  3.  (47) 

The  Bo  and  Co  matrices  for  the  open-loop  system  are  constructed  from  these  two  sets  and 
then  represent  the  structure  of  the  uncertainty  in  an  internal  feedback  model.  These  matrices 
are  augmented  with  additional  zeroes  to  compensate  for  the  dynamics  of  the  controller  [19, 
15],  and  they  then  can  be  used  to  represent  the  structure  of  the  uncertainty  in  the  closed-loop 
system  a  Ad- 

Note  that  CoBq  =  0  with  the  uncertainty  model  in  Eq.  47.  However,  the  code  used  to 
perform  this  example  was  written  for  the  more  general  structure  of  aA  with  CqBo  ^  0.  Note 
that  removing  the  assumption  in  Ref.  [21]  significantly  complicated  the  expressions  for  P  in 
Eq.  14  and  Ro  in  Eq.  refeq;4.4.  As  indicated  in  Section  4,  the  code  could  also  be  used  for  the 
block  diagonal  multipliers  that  are  associated  with  repeated  parameter  uncertainties.  This 
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Figure  5:  Diagonal  elements  of  the  stability  multiplier  H  for  the  analysis  per¬ 
formed  using  the  ME  controller. 

(a  factor  of  10)  corresponds  to  a  significant  performance  improvement.  The  location  of  the 
vertical  asymptotes  in  each  of  the  curves  corresponds  to  the  limits  of  robust  stability  for  that 
particular  compensator. 

For  each  controller,  the  symbol  “x”  on  the  performeince  axis  indicates  the  H2  performance 
achieved  by  that  design  on  the  nominal  design  model.  In  each  case,  it  can  be  seen  that  the 
nominal  performance  and  the  worst  case  overbound  are  quite  close.  This  observation  agrees 
with  the  results  in  Ref.  [19],  and  further  indicates  that  the  Popov  H2  cost  overbound  is  quite 
tight.  Also  note  that  each  of  the  SWLQG,  ME,  and  MM  designs  have  been  implemented 
on  the  test  article,  and  that  these  designs  represent  the  best  performance  that  could  be 
experimentally  achieved  using  that  particular  technique  [2].  Thus,  the  compensators  were 
not  necessarily  designed  for  the  same  values  of  p  and  p.  Furthermore,  the  best  stabilizing 
LQG  design  could  only  obtain  approximately  4  dB  on  the  hardware,  so  the  LQG  example 
in  the  figure  is  presented  just  to  show  how  sensitive  optimal  LQG  controllers  are  to  changes 
in  the  modal  frequencies. 
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is  a  correction  step  which  changes  the  multipliers  at  the  initial  value  of  Ao-  These  results 
show  that  the  multiplier  coefficients  change  significantly  with  A,  which  indicates  the  need 
for  a  good  algorithm  for  predicting  the  changes  from  »/(A,)  to  T]{Xi  +  aA).  The  symbols  on 
the  graphs  correspond  to  the  results  at  the  end  of  a  prediction—correction  iteration. 

The  results  of  this  analysis  can  also  be  used  to  initialize  a  redesign  of  the  robust  con¬ 
trollers  using  Popov  Controller  Synthesis  [11,19].  An  example  of  this  procedure  is  illustrated 
in  Figure  6.  The  stable  MM  controller  was  used  as  the  initial  design,  along  with  the  multi¬ 
pliers  computed  at  M2(A)  =  0.0585.  This  point  is  indicated  by  the  symbol  “o”  in  Figure  6. 
The  controller  was  redesigned  using  a  synthesis  technique  that  optimizes  the  cost  overbound 
with  respect  to  both  the  multiplier  coefficients  and  the  controller  gains.  The  synthesis  opti¬ 
mization  and  stopping  criterion  are  similar  to  the  correction  step  in  the  analysis  algorithm. 
In  Figure  6,  the  synthesis  corresponds  to  a  reduction  in  the  cost  overbound  at  a  constant 
value  of  M2(A).  The  final  result  is  shown  in  the  figure  by  the  symbol  “x”  at  M2(A)  =  0.0585. 
As  indicated,  the  robust  performance  at  this  level  of  the  guaranteed  stability  bounds  has 
been  improved  by  almost  1  dB. 

To  complete  this  example,  the  new  Popov  design  was  then  analyzed  in  two  different 
ways.  The  algorithm  was  started  at  Ao  =  1  x  10“^  with  the  same  initial  values  used  in  the 
original  MM  analysis.  The  algorithm  was  also  started  using  the  multiplier  values  calculated 
by  the  synthesis  code.  The  fact  that  these  two  analysis  curves  essentially  over  plot  indicates 
that  the  analysis  procedure  is  not  overly  sensitive  to  the  initial  conditions.  These  analysis 
results  indicate  that  the  Popov  design  achieves  superior  nominal  and  robust  performance  as 
compared  to  the  MM  controller,  and  that  the  robust  stability  boundaries  are  substantially 
improved  (~  20%). 

Thus,  Figure  3  illustrates  the  utility  of  this  analysis  tool  in  an  iterative  control  design 
methodology  based  on  several  robustness  techniques  with  differing  capabilities  and  compu¬ 
tational  requirements.  Furthermore,  Figure  6  demonstrates  that  the  Popov  analysis  and 
synthesis  techniques  can  be  combined  to  overcome  the  difficulty  of  developing  initial  values 
for  the  stability  multipliers  at  large  guaranteed  stability  bounds. 

6  Conclusions 

Good  robust  performance  analysis  plays  a  critical  part  in  the  design  of  robust  controllers. 
Previous  results  have  shown  that  the  Popov  criterion  is  much  less  conservative  than  small  gain 
tests  for  systems  with  real  parameter  uncertainties.  This  paper  extends  this  earlier  work  by 
developing  algorithms  to  analyze  systems  with  multiple  uncertainties  that  have  both  upper 
and  lower  sector-bounds.  The  typical  application  of  this  procedure  was  demonstrated  using 
robust  controllers  for  MACE.  The  combined  optimal  analysis  and  synthesis  algorithms  were 
also  used  to  design  a  new  controller  that  yields  better  robust  'H2  performance  with  larger 
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Appendix:  Jacobian  Expressions 


As  discussed  in  Section  4,  solving  the  homotopy  problem  requires  the  computation  of 
the  Jacobian  of  the  homotopy  map.  The  first  part  of  the  Jacobian  in  Eq.  36  is  given  by  the 
symmetric  matrix 


dHi  dHi  dHx 

da  '  dNij  dHij 


veCAr( 


dH2 

dNy, 


)  ■■■  vecN{ 


dHi/  ’ 


(48) 


where  Hj,  H2,  and  H3  are  defined  in  Eqs.  25-27.  Note  that  only  the  free  parameters  of 
N  and  H  are  considered  in  the  calculation  of  Lr,.  Also,  the  columns  of  Lj,  are  arranged  to 
be  consist  with  the  result  produced  by  the  vec/^(-)  operator.  Let  Ejj  =  e^ej,  where  each 
element  of  the  column  is  zero,  except  for  the  ith  term  which  is  unity.  In  the  following,  the 
dimension  of  Ejj  is  the  same  as  the  dimension  of  H.  For  convenience,  we  first  note  that 
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where,  as  before,  6j  refers  to  any  free  element  of  H  or  N.  The  gradient  expressions,  in  turn, 
depend  on  the  solutions  to  the  equations 
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which  are  based  on  the  solutions  to  the  equations 
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Then  Lx  in  Eq.66  can  be  written  in  terms  of 
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Note  that  each  of  the  Lyapunov  equations  for  the  derivative  terms  has  the  same  dynamics 
matrix,  A2.  In  this  work,  the  Lyapunov  equations  are  solved  using  an  eigenvalue  decompo¬ 
sition  of  A2.  Thus,  the  decomposition  need  only  be  performed  once  per  Hessian  calculation, 
which  significantly  decreases  the  computational  effort  required  to  determine  this  matrix. 
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Abstract 

Over  the  last  several  years,  researchers  have  shown  that  when  it  is  assumed  0  priori  that  a 
fixed-order  optimal  compensator  is  minimal,  the  necessary  conditions  can  be  characterized  in  terms 
of  coupled  Riccati  and  Lyapunov  equations,  usually  termed  “optimal  projection  equations.”  When 
the  optimal  projection  equations  for  Ho  optimal  control  are  specialized  to  full-order  control,  the 
standard  LQG  Riccati  equations  are  recovered.  This  paper  relaxes  the  minimality  assumption  on 
the  compensator  and  derives  necessary  conditions  for  fixed-structure  Ho  optimal  control  that  reduce 
to  the  standard  optimal  projection  equations  when  the  optimal  compensators  are  assumed  to  be 
minimal.  The  results  are  then  specialized  to  full-order  control.  The  results  show  that  the  standard 
LQG  Riccati  equations  can  be  derived  using  fixed-structure  theory  even  without  the  minimality 
assumption.  They  also  show  for  the  first  time  that  a  reduced-order  optimal  projection  controller 
is  a  projection,  described  by  a  projection  matrix  p.  of  one  of  the  extremals  (a  “central  extremal”) 
to  the  full-order  H2  optimal  control  problem.  For  nonminimal  LQG  compensators  the  projection 
matrix  u  used  in  balanced  controUer  reduction  produces  a  minimal-order  realization  of  the  LQG 
compensator,  which  is  of  course  an  optimal  reduced-order  compensator.  For  this  special  case,  the 
similarity  transformations  relating  i/,  p  and  the  optimal  projection  matrix  r  from  standard  optimal 
projection  theory  are  explicitly  defined.  Finally,  an  illustrative  numerical  example  is  presented  to 
demonstrate  the  design  framework  discussed  in  this  paper  for  H2  optimal,  reduced-order,  dynamic 
compensation. 
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1 .  Introduction 


One  of  the  foundational  results  in  modern  control  theory  is  the  development  of  a  characteriza¬ 
tion  of  the  globally  optimal  controller  via  algebraic  Riccati  equations  [1-3].  This  result  has  tradi¬ 
tionally  been  derived  via  the  Calculus  of  Variations  or  the  Maximum  Principle  in  conjunction  with 
the  Separation  Principle  [2-4].  Unfortunately,  the  optimal  H2  or  LQG  (Linear-Quadratic-Gaussian) 
controller  has  dimension  equal  to  that  of  the  plant,  although  it  may  have  minimal  dimension  which 
is  less  than  that  of  the  plant.  This  has  motivated  the  search  for  optimal  reduced-order  controllers, 
that  is,  controllers  that  have  dimension  less  than  that  of  the  plant. 

Because  the  Calculus  of  Variations  and  the  Maximum  Principle  characterize  globally  optimal 
solutions,  these  traditional  methods  for  deriving  the  LQG  result  do  not  extend  to  the  development 
of  characterizations  of  optimal  reduced-order  controllers.  Hence,  researchers  have  developed  op¬ 
timization  methods  that  allow  the  dimension  and  structure  of  the  controller  to  be  constrained  a 
priori  (see,  e.g.,  [5-9]).  These  methods  are  usually  based  on  Lagrange  multiplier  theory  and  will  be 
called  here  “fixed-structure  approaches.”  The  “optimal  projection”  characterization  of  the  neces¬ 
sary  conditions  for  optimal  reduced-order  control  [6]  was  derived  using  a  fixed  structure  approach 
and  yields  the  standard  LQG  regulator  and  observer  Riccati  equations  when  the  dimension  of  the 
controller  is  specified  to  be  equal  to  the  dimension  of  the  plant.  However,  the  original  optimal 
projection  results  and  numerous  extensions  (e.g.,  [7-9])  were  derived  by  a  priori  assuming  that  the 
controller  is  minimal.  This  is  a  limiting  assumption  since  it  is  known  that  even  an  LQG  controller 
is  not  always  minimal  [10].  It  should  be  noted  here  that  the  LQG  Riccati  equations  are  also  de¬ 
rived  in  [11]  using  a  fixed-structure  approach.  However,  the  results  there  0  priori  assume  that 
Ac  =  A  +  BCc  -  BcC,  where  (A,R,C)  is  the  plant  triple  and  {Ac,Bc,Cc)  denotes  the  controller 
triple. 

This  paper  presents  optimality  conditions  that  are  derived  without  assuming  the  minimality 
of  the  compensator.  A  similar  approach  was  also  considered  in  [12].  The  results  are  specialized  to 
the  case  in  which  the  compensator  is  constrained  to  have  the  dimension  of  the  plant.  It  is  shown 
that  even  when  compensator  minimality  is  not  assumed,  fixed-structure  theory  is  able  to  derive 
the  LQG  Riccati  equations.  It  is  also  shown  that  there  exist  sets  of  coupled  Riccati  and  Lyapunov 
equations  that  are  identical  in  form  to  the  optimal  projection  equations  for  reduced-order  control 
but  actually  characterize  extremals  to  the  full-order  compensation  problem.  This  leads  to  a  new 
interpretation  of  an  optimal  projection  controller.  In  particular,  an  optimal  projection  controller 
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is  a  projection,  described  by  a  projection  matrix  /i,  of  a  “central”  extremal  to  the  U2  optimal, 
full-order  compensation  problem. 

For  nonminimal  LQG  compensators  the  projection  matrix  u  used  in  balanced  controller  reduc¬ 
tion  produces  a  minimal-order  realization  of  the  LQG  compensator,  which  is  of  course  an  optimal 
reduced-order  compensator.  For  this  special  case,  the  similarity  transformations  relating  and 
the  optimal  projection  matrix  r  from  the  standard  optimal  projection  theory  are  explicitly  defined. 

The  primary  reason  for  developing  the  Riccati  equation  approach  to  reduced-order  dynamic 
compensation  is  to  enable  the  development  of  efficient  computational  algorithms  for  controller 
synthesis.  In  particular,  the  goal  has  been  to  develop  algorithms  that  exploit  the  special  structure  of 
the  Riccati  equations.  This  paper  gives  a  brief  overview  of  the  continuation  algorithm  developed  in 
[13, 14]  that  utilizes  the  special  Riccati-equation  structure.  The  results  are  illustrated  by  developing 
reduced-order  controllers  for  an  important  benchmark  problem  in  structural  control. 

The  paper  is  organized  as  follows.  Section  2  presents  the  optimal  fixed-structure  dynamic 
compensation  problem  and  some  preliminary  lemmas.  Section  3  develops  necessary  conditions 
characterizing  solutions  to  the  optimal  fixed-structure  dynamic  problem  without  an  a  priori  minimal 
compensator  assumption.  Next,  Section  4  specializes  the  optimality  conditions  to  the  case  of  full- 
order  dynamic  compensation  and  discusses  the  relationship  between  a  “central”  extremal  and  the 
LQG  compensator.  Section  5  demonstrates  the  utility  of  the  optimal  reduced-order  controller 
design  framework  discussed  in  the  previous  sections  with  a  benchmark  numerical  example.  Finally, 
Section  6  presents  the  conclusions. 


Notation 


IR,]R”''^IR” 

IE 

n{x),M{x) 


X* 


X  >  0,  A"  >  0 

Orxs 

It 


real  numbers,  r  x  s  real  matrices,  IR”^^ 
expected  value 

range  space  of  matrix  X,  null  space  of  matrix  A' 
Moore-Penrose  generalized  inverse  of  matrix  A’  [15] 
group  inverse  of  matrix  A’  [15] 

matrix  X  is  nonnegative  definite,  matrix  X  is  positive  definite 
r  X  s  zero  matrix 
T  X  r  identity  matrix 
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2.  The  Optimal  Fixed-Structure  Dynamic  Compensation  Eh-oblem 

Consider  the  n*'‘-order  linear  time-invariant  plant 

x{t)  =  Ax{t)  +  Bu{t)  +  Diw{t),  (2.1fl) 

yit)  =  Cx{t)+D2w{t),  (2.16) 

where  iA,B)  is  stabilizable,  {A,C)  is  detectable,  x  €  IR",u  €  €  IR^  and  w  £  111“^  is  a 

standard  white  noise  disturbance  with  intensity  and  rank  D2  =  /■  The  intensities  of  Diw{t)  and 
D2w{t)  are  thus  given,  respectively,  by  Vi  =  D^DJ  >  0,  and  V2  =  D2DJ  >  0.  For  convenience,  we 
assume  that  =  D^Dj  =  0,  i.e.,  the  plant  disturbance  and  measurement  noise  are  uncorrelated. 
The  goal  of  the  optimal  fixed-order  dynamic  compensation  problem  is  to  determine  an  n*^-order 
dynamical  compensator 

Xc{t)  =  AcXcit)  +  Bcy{t),  (2.2a) 

u{t)  =  -CcXcii),  (2.26) 

which  satisfies  the  following  two  design  criteria: 

{i)  the  closed-loop  system  corresponding  to  (2.1)  and  (2.2)  given  by 

x(t)  =  Ax{t)  +  Dw{t),  (2.3) 


where 


is  asymptotically  stable;  and 


xit)  = 


A 

■  x{t)  ■ 

A  - 

_Xc{t)_ 

?  — 

A 

B,C 


-BCc 

A 


C  J 


D 


(2.4, 5, 6) 


{ii)  the  compensator  minimizes  the  steady-state  quadratic  performance  criterion 

i 

J{Ac,Bc,Cc)^  lim  -E  [ [x'^{s)Rix{s)  u'^{s)R2u{s)]ds,  (2.7) 

t-^OO  t  J 

0 

where  Ri  >  0  and  i?.2  >  0. 

Although  a  cross-weighting  term  of  the  form  2x^ {t)Ri2u{t)  can  also  be  included  in  (2.7). 
we  shall  not  do  so  here  to  facilitate  the  presentation.  With  the  first  criterion,  we  restrict  our 
attention  to  the  set  of  stabilizing  compensators,  Sc  =  {{A^  Bc^Cc)-  A  is  asymptotically  stable} 
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which  guarantees  that  the  cost  J  is  finite  and  independent  of  initial  conditions.  Tlie  cost  (2.()  can 


now  be  expressed  as 

J{Ac,Bc,Cc)=  lim  m[x'^[t)Rx{t)], 

1— ►00 

(2.8) 

where 

=  £,  R\  0 

^~[0  CJR2Cc/ 

Next,  by  introducing  the  performance  variable 

(2.9) 

z{t)  =  Eix{t)  +  E2uit)  =  Ex{t), 

(2.10) 

and  defining  the  transfer  function  from  disturbances  w  to  performance  variables  z  by 

H{s)  =  Eish-A)-'^£),  ■ 

where  E  =  [£i  E2Cc],  and  n  =  n  +  ric,  it  can  be  shown  that  when  A  is  asymptotically  stable,  (2.8) 
is  given  by  J{Ac,Bc,Cc)  =  ||.ff(5)||^  For  convenience  we  thus  define  the  matrices  Ri  =  Ej Ei  and 
R2  =  EJE2  which  are  the  H2  weights  for  the  state  and  control  variables.  Since  A  is  asymptotically 
stable,  there  exist  nonnegative-definite  matrices  Q  €  and  P  G  satisfying  the  closed- 

loop  steady-state  covariance  equation  and  its  dual,  i.e., 


0  =  AQ  A  Q A^  -f  V , 

0  =  A^P  +  Pa  +  R, 


where 


V  = 


Vi  0 

0  BcV2BJ 


The  cost  functional  (2.7)  can  now  be  expressed  as 

J{Ac,Bc,Cc)  =  tr  QR  =  tr  Pv. 
Furthermore,  Q  and  P  can  be  expressed  in  the  partitioned  forms 

Q  = 


p  = 


Qi 

Qu 

Qu 

Q2. 

Pl2' 

[p72 

^2  . 

,Pi  €  IR”^”,P2  € 


(2.11) 

(2.12) 

(2.13) 


(2.14) 


(2.15) 

(2.16) 
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Note  that  Qi  is  the  covariance  of  the  plant  states,  Q2  is  the  covariance  of  the  compensator  states 
and  Qn  is  the  cross-covariance  of  the  plant  and  controller  states.  Using  (2.6),  (2.9),  (2.13)  (2.15) 


and  (2.16),  and  expanding  (2.11)  and  (2.12),  yields 

0  =  AQ^+  QiA'^  -  BCcQj^  -  QuCJb'^  +  Vj,  (2.17) 

0  =  AQ^2  +  QuAJ  -  BCcQ2  +  QiC^Bj,  (2.18) 

0  =  AcQ2  +  Q2A'^  +  BcCQu  +  Qj2C^Bj  +  BcV2BJ  ,  (2.19) 

0  =  A'^Pi  +  PiA  +  C'^BJP^2  +  PnBcC  +  i?i,  (2.20) 

0  =  A'^Pu  +  PnAc  +  C^B'IP2  -  PiBCc,  (2.21) 

0  =  aJP2  +  P2Ac  -  PjiBCc  -  CjB'^Pn  +  CJR2Cc.  (2.22) 


Before  presenting  the  main  theorems  we  present  the  following  key  lemmas  and  definitions  which 
are  useful  in  stating  and  proving  the  main  results  of  the  paper.  First,  we  introduce  the  notion  of  a 
projection.  Specifically,  let  A\  and  A2  denote  subspaces  of  a  linear  vector  space  A'.  Then  A\  and 
A’o  are  a  decomposition  of  A'  if  and  X2  are  disjoint,  i.e.,  D  Ai  =  0,  and  every  vector  x  E  Af 
can  be  uniquely  expressed  as  x  =  xj  X2,  such  that  x^  €  A'l  and  12  £  '^2-  A’  is  called  the  direct 
sum  of  A’l  and  A’o,  or.  A’  =  A\  ©  Afj. 

Definition  2.1.  (Rao  and  Mitra  [15]).  The  bnear  operator  L  :  x  x-^  is  called  a  projection 
on  A'l  along  A’2 . 

Definition  2.2.  A  n  x  n  matrix  r  is  a  projection  matrix  if  r  is  idempotent,  i.e.,  =  r. 

Remark  2.1.  A  projection  matrix  r  defines  a  projection  on  7^(r)  along  A^(r),  which  impbes 
that  for  two  projection  matrices  ti  and  T2,  if  P-iji)  =  'JZ{t2)  and  A^(ti)  =  A'{t2)  then  ti  and  T2 
define  the  same  projection. 

Lemma  2.1.  (Rao  and  Mitra  [15]).  Suppose  A'  and  Y  are  matrices  with  compatible  dimen¬ 
sions.  Then 

(0  A^(F)  C  N{X)  if  and  only  if  =  x. 

(nj  7^(y)  C  11{X)  if  and  only  if  AA^y  =  A. 

Lemma  2.2.  Assume  A  is  asymptotically  stable  and  Q  and  P  are  the  fi  x  h  nonnegative- 
definite  solutions  of  (2.11)  and  (2.12).  Let  Q  and  P  be  partitioned  as  in  (2.15)  and  (2.16).  Then, 
the  following  relations  hold: 
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(0  MiPi)  c  Af{Pi2)- 


(n)  Af{P2)cMCc)- 

(Hi)  MiPi)  is  the  unobservable  subspace  of  {Ac,Cc)- 
(?u)  M(Q2)  C  MiQu)- 
(v)  AriQ2)cM{B'J). 

{vi)  Af{Q2)  is  the  uncontrollable  subspace  of  (Ac,  Be). 

Proof.  Let  v  ^  N{P2)~.ot,  equivalently,  P2V  -Q.  Consider  a  vector  x  defined  by 


where  a  €  IR  is  arbitrary.  It  follows  from  P  >  0  that 

x'^ Px  =  +  2QtJ^P^Pi2V  >  0. 

The  above  expression  is  true  for  all  a  6  IR  if  and  only  if  P^u  =  0,  which  implies  u  €  A/'(Pi2),  or, 
equivalently,  j\f{P2)  C  Af{Pi2)- 

Forming  t;'^(2.22)t;  and  noting  P2V  =  0  and  P^v  =  0,  yields  v'^C'JR2CcV  =  0.  Since  R2  >  0, 
we  obtain  CeV  =  0,  which  implies  v  €  Af{Cc),  or,  equivalently,  M{P2)  C  A^(Cc). 

Forming  (2.22)t;  and  noting  CeV  =  0,  P2V  =  0,  and  P12U  =  0,  yields  P2  AeU  =  0.  Using  property 
(ii),  P2AcV  =  0  implies  CcAcV  =  0.  Thus,  v  €  unobservable  subspace  of  (Ac,Cc),  or,  equivalently. 
Af(P2)  C  unobservable  subspace  of  (Ac,Cc).  Using  the  dual  approach,  properties  {iv),{v)  and  (uz) 
can  be  verified.  □ 

Lemma  2.3.  (Albert  [16]).  If  A  is  asymptotically  stable,  then 


P12  =  P12PJP2,  PI2  =  P2P2PI2, 

(2.23a,  6) 

?12  =  <312^2^2,  QI2  —  C2<32012’ 

(2.24a,  6) 

Cc  =  CcP2^P2,  CJ  =  P2P2^CJ, 

(2.25a, 6) 

Bc  =  Q2QIBc,  bJ  =  BJqIQ2. 

(2.26a. 6) 

Proof.  The  result  is  a  direct  consequence  of  Lemma  2.1  along  with  statements  (z), 
and  (u)  of  Lemma  2.2.  □ 
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Lemma  2.4.  Suppose  Q  G  and  P  G  are  nonnegative  definite  with  rank  Q  =  n,, 

rank  P  =  Up  and  rank  QP  =  n^.  Then,  the  following  statements  hold: 

(i)  There  exists  invertible  W  €  IR”^"  such  that  W~'^QW~’^  and  W'^PW  are  both  diagonal. 

(ii)  Qp  is  diagonaUzable  and  has  nonnegative  eigenvalues. 

(Hi)  The  n  X  n  matrix 

r  =  QP(QP)*  (2.27) 


is  idempotent,  i.e.,  r  is  a  projection  matrix  and  rank  r  =  nr- 
Furthermore,  there  exists  a  nonsingular  matrix  W  G  such  that 


T  =  W  °  W-\ 


(2.28) 


In  addition,  if  we  define  t±  =  In  —  r,  then  rank  rx  =  n  —  iir- 
iv)  There  exists  a  nonsingular  transformation  such  that 


Q  = 


^1  OnrX(np-nr)  x(n, -n,)  On,.xn, 

0(np-n,)xnr  0  0  0 

0(n,-nr)xnr  b  fls  0 

On,  xnr  0  0  0 


(2.29) 


0nrX(np  — nr)  0nrX(n,— n^)  OnrXn, 
p  _  tt^-T  0(np-n,)xnr  ^^2  0  0  Tr/-1 

0  0  o’’ 

L  0„,xn.  0  0  0  J 


(2.30) 


where  nj  =  n  -  (np  +  n,  -  n^)  and  fii  €  fia  €  IR*’"’'  and  Q3  e 

jj^(n,-np)x(n,-n,)  diagonal  and  positive  definite. 

(u)  Suppose  ric  >  Tip  +  ng  -  rir-  Then  there  exist  G,r  £  IR"*’'”,  and  M  £  IR"'’'"'  such  that 
TZ(G'^)  =  TZ{Q),  TZ(r'^)  =  'R-(P)-,  and  rank  M  =  rank  QP  =  rir  (2.31a,  6,  c) 


QP  =  G^MP, 

—  p  0nrX(nc— rip)  — 1 

.0(nc-np)xnr  0 


(2.32) 


(2.33) 


where  T  is  an  arbitrary  Uc  X  Uc  nonsingular  matrix. 


{vi)  The  matrices  G.F  e  and  M  €  satisfying  (2.31)-(2.33)  are  unique  except 

for  a  change  of  basis  in  ]R”%  i.e.,  if  G\r'  and  M'  also  satisfy  property  (r),  then  there 
exists  nonsingular  S  €  such  that  G'  =  S'^G,!''  =  5  and  M'  =  S  ^MS. 

{vii)  If  G.r  and  M  are  as  in  (u),  then 


iQp)*  =  G'^M^r, 

(2.34) 

=  QPiQp}*  =  G'^r. 

(2.35) 

Proof.  Properties  (i)-ini)  are  stated  and  proved  in  [17].  Property  {iv)  is  a  direct  consequence 
of  Theorem  4.3  in  [18]. 

To  prove  (u)  we  note  that  using  property  {iv},  Q  and  P  can  be  contragrediently  diagonalized 
as  in  (2.29)  and  (2.30),  respectively.  Thus,  it  follows  that 


QP  =  14^ 


0nrX(n  — Tlr) 

[0(n-nr)xnr  0 


w 


Furthermore,  using  the  fact  that  for  arbitrary  dimensionally-compatible  matrices  X  and  5',  7^(A*) 
niXX'^)  and  n{XY)  =  Xn{Y),  it  follows  that 


n{Q)  =  wni 

Similarlj',  we  can  obtain 

n{P)  =  w-'^TZi 

Next,  choose 


^1^  0„^x(np— Tir)  0nrX(n,-np)  0n,xn, 

0(np-nr)xnr  b  0  0 

0(n,-nr)xnr  0  ^3^  0 

On.xn,  0  0  0 


^1^  n,)  bnrX(n,-nr)  On^xn, 

0(np-n..)xn..  ^2^  0  0 

0(n,-n,)xnp  0  0  0 

0  0  0 


TLi  XTlr 


G'  = 


^Tlr  0nrX(np— Tlr)  07;^X(n,— Hr) 

0(np-nr)xnr  0  0  0 

0(nq —nr  )  X  Tlr  0  ^ng—Tlr  0 

0(nc-(np  +  n,-nr))xnr  0  0  0 


r'  = 


0(7tp-7 
0(n<,-nr  )xnr 
0(Tic-(np+n<y-«n^))X7i^ 


Oti^  x(T7p-7ir)  OnrX(n^-nr)  O^i^Xn, 
Inp—Ur  0  0 

0  0  0 

0  0  0 


H 
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M'  = 


OnrX(n<;-nr) 
[0(7i^-nr)Xnr  0 


Then  it  is  easy  to  show  by  construction  that  {G' ,  M' ,  F')  satisly  (2.31)-(2.33)  with  T  —  /„^  for  this 
particular  case  which  proves  property  (u). 


To  prove  property  (m),  consider  a  general  triple  (G,M,  T)  satisfying  (2.31)-(2.33).  Noting 
the  above  expression  for  HiQ),  it  follows  that  the  general  expression  for  a  matrix  G  satisfying 

7^(GT)  =  n{Q)  is 


G  = 


OnrX(np-n,)  OnrX(n,-nr)  On^xn, 

0(„,-n.)xn.  0  0  0 

0(n,-nr)XTir  0  G3  0 

0(nc-(np  +  n,-n,))xnr  ^  0  0 


w 


where  Gi  €  and  G3  €  are  nonsingular.  Noting  the  structure  of  G  and 

G',  we  can  always  find  a  nonsingular  Uc  x  ric  matrix  Tc  such  that  G  =  Tq^G' .  Similarly,  using  the 
identity  that  TZ{r'^)  =  TliP),  there  exists  a  nonsingular  tic  X  Uc  matrix  Tr  such  that  F  =  TpF' . 
However,  using  (2.33)  yields  Tp  =  Tc  —  T.  Furthermore,  it  follows  from  (2.32)  that  M  =  TM'T  ^ . 
Thus  {G,  M,  F)  is  unique  except  for  a  change  of  basis  in  IR”‘ . 


Finally,  to  prove  (vH)  it  follows  from  properties  (v)  and  {vi)  that  for  a  general  (G,M,F) 
satisfying  (2.31  )-(2.33), 


G'^M^F  =  W 


0 


-1 

1 


0 


(n  —  Tir )  Xn^ 


On,  x(n-n,) 

0 


W-^  =  {QPf, 


and  G'^F  =  W 


0 

0 


W-^  =  T. 


□ 


Defiirition  2.3.  A  triple  (G.M.F)  satisfying  (2.31)-(2.33)  with  G,  T  G  IR”' A/ 
and  ric  >  Tir  =  rank  QP  is  called  a  -order  generalized  projective  factorization  of  QP.  If  =  Ur. 
then  {G,M,F)  is  called  a  projective  factorization  of  QP  [17]. 


Lemma  2.5.  Assume  that  A  is  asymptotically  stable  and  that  Q  and  P  are  the  h  x  h 
nonnegative-definite  solutions  of  (2.11)  and  (2.12).  Let  Q  and  P  be  partitioned  as  in  (2.15)  and 
(2.16)  and  define 

Q  =  QuQIQJ2^  (2-36) 

P  =  PnPiPu-  (2-37) 

Furthermore,  let  G,  M  and  F  be  given  by 

G^QlQj..  (2-38) 
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(2.39) 


M  =  Q2P21 

and 

r=-P^P^-2-  (2-40) 

If 

P^2Qn  +  P2Q2^0,  (2.41) 

then  the  following  hold: 

(i)  The  nonzero  eigenvalues  of  QP  and  Q2P2  a-re  identical. 

(ii)  The  triple  {G,M,r)  satisfies  property  (u)  of  Lemma  2.4,  or,  equivalently,  (GAPP)  is  a 
n‘^-order  generalized  projective  factorization  of  QP. 

Proof.  First,  note  that  it  follows  from  (2.36)  and  (2.37)  that 

QP  =  Qi2QlQj2Pi^P^Pl2-  (2-42) 

Next,  using  (2.41)”^,  it  follows  that  Q12P12  =  -Q2P2  which  substituting  into  (2.42)  yields  QP  = 
-QuQlQ'^PiP^Pu-  Since  A  is  assumed  to  be  asN^mptotically  stable,  using  (2.23b)  and  (2.24a)  of 
Lemma  2.3,  yields 

QP=-Qi2Pl2-  (2.43) 

Finally,  it  follows  from  (2.43)  and  (2.41)"^  that 

XiiQP)  =  Xi{-Q,2P^2)  =  H-PuQi2)  =  UP2Q2). 

where  Xi(-)  represents  a  nonzero  eigenvalue  of  QP.  Thus,  the  nonzero  eigenvalues  of  QP  and  Q2P2 
are  identical. 

Next,  without  loss  of  generality,  let  rank  Q2  =  Ug  and  rank  P2  =  Up.  Using  the  property  (i), 
yields 

rank  Q2P2  =  rank  QP  =  Ur.  (2.44) 

Thus,  using  (2.44)  and  (2.39)  it  follows  that  rank  M  -  rank  QP.  Furthermore,  it  follows  from 
(2.38),  (2.39)  and  (2.40)  that 

G'^MP  =  -Ql2Q2Q2P2P2Pl2- 
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Next  using  (2.41)’^,  yields  (2.32).  Computing  (2.40)(2.38)'^,  yields  FG^  =  -PIpJ2Q\2Q\-  Now- 
using  (2.41),  we  obtain 

PG'^  =  PIP2Q2QI  (2.45) 


Since  Q2  and  P2  are  nonnegative  definite,  using  property  (iv)  of  Lemma  2.4  with  n  =  Uc,  there 
exists  a  nonsingular  T  £  such  that 


■ 

^n, x(np—r 

Ir) 

On,  x(n,  -n,) 

On,,  xn. 

Q2  =  T 

0(np~nr)xnr 
0(n^-nr  )Xnr 

0 

0 

0 

fis 

0 

0 

(2.46) 

- 

Ont  X  Ur 

0 

0 

0  . 

On,  x(np  - 

Tlr) 

On,x(Ti,-n,) 

Onp  xn. 

P2  =  T-'^ 

0(np-nr)X7lr 
0(n^  -Ur)  Xrir 

CI2 

0 

0 

0 

0 

0 

T-\ 

(2.47) 

On,  X  Tlr 

0 

0 

0  . 

where 

m  =  Uc  — 

in.p  +  rig  -  n 

r)  and  fl] 

€ 

n^n.xn,  ^  J),  € 

IR(7ip-n 

r)x(Tlp  Tlr) 

and  fia  G 

IR'”''" 

nr)x(ng-nr) 

are  diagonal  and  positive  definite. 

Forming  (2.46)(2.46)'^, 

j  yields 

■  In. 

^71,-  X  (  Tip 

■Tlr) 

Orir  x(n,  —n. ) 

Onp  X  n, 

Q2qI  =  t 

O^Tlp  X  Tlj- 

0^?T,^  “"Tly-  )  'X,  TLj- 

0 

0 

0 

In^  —n. 

0 

0 

T-\ 

(2.48) 

On,  XUr 

0 

0 

0  . 

Similarly,  (2.47)i(2.47)  yields 

-  In. 

Our  x(np  — 

Tlr  ) 

Orir  X(71, -n.) 

Onp  X  n, 

II 

0(  Tip  Tlr  )  X  Tlr 

0(n^  -7ir)xnr 

Inp  — n, 
0 

0 

0 

0 

0 

T-\ 

(2.49) 

On,  Xrir 

0 

0 

0  . 

Substituting  (2.48)  and  (2.49)  into  (2.45),  yields  (2.33).  Note  that  Q2  is  symmetric  which  implies 
that  <52  is  symmetric,  QI  —  {Q\)^{,Q2)^~  and  'R.iQl)  =  7^((<?2)^)-  Thus,  it  follows  from  the  basic 
matrix  geometric  properties  that 


TZiQ)  =  TZiQj.QlQjo) 

=  n{Qu{Ql)HQl)'Ql) 

=^nQu{Qi)-^) 

=  Qx2'JliiQl)h 
—  Ql2'^iQ2) 

=  TZiQuQl) 

=  7^(C?^). 
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Following  the  dual  approach  yields  TZ{P)  =  TZ{r^}.  □ 


With  the  above  collection  of  lemmas  and  definitions  we  proceed  in  providing  necessary  con¬ 
ditions  for  optimality  for  the  generalized  fixed-structure  dynamic  compensation  problem.  These 
conditions  are  developed  in  the  following  section. 

3.  Optimality  Conditions  for  Fixed-Order  Dynamic  Compensation 

In  this  section  we  obtain  necessary  conditions  that  characterize  solutions  to  the  optimal  fixed- 
structure  dynamic  compensation  problem.  Unlike  previous  results,  the  compensators  are  allowed 
to  be  nonminimal.  We  begin  by  presenting  the  following  key  definitions. 


Definition  3.1.  A  compensator  (Ac,Bc,Cc)  is  an  extremal  of  the  optimal  generalized  fixed- 
order  dynamic  compensation  problem  if  it  satisfies  the  first  order  necessary  conditions  of  optimality, 


i.e.. 


dJ 

dA, 


=  0, 


dJ 

dB, 


=  0, 


dJ 

dC, 


=  0, 


where  J{Ac.,Bc,Cc)  is  defined  in  (2.7). 


Definition  3.2.  A  compensator  (Ac,5c,Cc)  is  an  admissible  extremal  of  the  optimal  gener¬ 
alized  fixed-order  dynamic  compensation  problem  if  it  is  an  extremal  and  is  also  in  5c,  i.e.,  the 
closed-loop  system  is  asymptotically  stable. 

Finally,  for  convenience  in  stating  the  main  results  we  define 

t  =  c'^vf^c,  i:  =  br7^b"^. 


Theorem  3.1.  Suppose  {Ac,  Bc,Cc)  is  an  admissible  extremal  of  the  optimal  fixed-order 
dynamic  compensation  problem.  Then,  there  exist  n  x  n  nonnegative-definite  matrices  P.  Q.P  a.nd 
Q  such  that  Ac,  Be  and  Cc  are  given  by 

Ac  =  r{A  -  SP  -  Qt)G^  +  Z-  P^P2ZQ2QI,  (3.1a) 

Be  =  PQC'^Vf^  -f  (/„.  -  P^P2)X,  (3.16) 

Cc  =  R^^B^PG'^  +  Y{ln,  -  Q2QI),  (3.1c) 

where  {G,M.r)  is  a  generalized  projective  factorization  of  QP,  and  A’  €  and 

Z  6  in  (3.1)  are  chosen  to  satisfy  the  following  constraints: 

P2Ac{In.-  PlP2)  =  ^,  (3.2) 
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Q2^J(/n,  -Q2Q1)  =  0,  (3.3) 

M{P2)cM{CcI  (3.4) 

A^(Q2)CA^(J9j).  (3.5) 

Here,  Q2  £  and  P2  €  01”“=  are  respectively  the  closed-loop  covariance  of  the  controller 

states  and  its  dual  and  P,Q,P  and  Q  satisfy: 

0  =  A^P  +  PA  +  Ri-  PEP  +  (Pj-'P'TP  -  C,P)'^P2(P2"’^'^-P  -  CcP),  (3.6) 

0  =  AQ  +  QA'^  +  Vy  -  QtQ  +  {QC'^Vi^  -  G'^ -  G^Pe)'^,  (3.7) 


0  =  (A  -  QtfP  +  P{A  -  Qt)  +  PEP  -  (R^^B'^P  -  CcrfR2{R2^B'^P  -  CcP),  (3.8) 
0  =  (^  -  EP)Q  +  Q{A  -  EPf  +  QEQ  -  {QC'^Vi^  -  G’^ Bc)V2{QC'^Vi^  -  G'^Bcf.  (3.9) 

Furthermore,  the  minimal  cost  is  given  by 

J{Ac,Bc,Cc)  =  tr[(P  +  P)Vy  +  PQEQ],  (3.10) 

or,  equivalently, 

J{Ac..B,,Cc)  =  tr[(Q  +  Q)Ry  -b  QPEP].  (3.11) 

Proof.  See  Appendix  A.  □ 

Remark  3.1.  Note  that  it  follows  from  Lemma  2.2  that  if  A  is  asymptotically  stable  then 
conditions  (3.2)-(3.5)  are  automatically  satisfied. 

Remark  3.2.  Note  that  when  P2  and  Q2  are  full  rank,  i.e.,  the  controller  {A^  Bc,Cc)  is 
minimal,  the  choices  of  X,  F,  and  Z  have  no  effect  on  (Ac,  Be-,  Cc)- 

Next,  we  specialize  Theorem  3.1  to  the  case  where  {A^Bc^Cc)  is  a  minimal  reduced-order 
compensator. 

Corollary  3.1.  Suppose  P2  and  Q2  in  Theorem  3.1  have  fuD  rank,  i.e.,  rank  P2  =  rank  Q2  = 
Tic  <  n.  Then,  there  exist  nonnegative-definite  matrices  P,Q,P  and  Q  such  that  Ac,  Be  and  Cc  are 
given  by 


=  P(A -QE-SP)G^, 

(3.12a) 

Be  =  PQC'^V^-P 

(3.126) 

Cc  =  R2'^B'^PG'^, 

(3.12c) 

13 

for  some  projective  factorization  (G,  M,r)  of  QP  and  such  that  the  following  conditions  are  satis¬ 


fied: 

0  =  A^P  +  PA  + Ri- PEP  +  tIP1:Pt^,  (3.13) 

0  =  AQ  +  QA'^ +  V:-QtQ  +  Tj_QEQT'l,  (3.14) 

0  =  (>1  -  QtfP  +  P{A  -  QL)  +  PEP  -  rJPEPrx,  (3.15) 

0  =  {A-^P)Q  +  QiA-'£Pf +  QI:Q -r^QtQrJ,  (3.16) 

rank  Q  -  rank  P  =  rank  QP  =  ric,  (3.17) 

T  =  {QP)iQPf.  (3.18) 

Furthermore,  the  minimal  cost  is  given  by 

J(Ae,Pe,C,)  =  tr[Pl/:  +  Q(PEP  -  rJPEPrx)],  (3.19) 

or,  equivalently, 

J{Ac,B,,Cc)  =  tr[QR,  +  P{QtQ  -  rxQEQrJ)].  (3.20) 


Proof.  The  proof  is  a  direct  consequence  of  Theorem  3.1.  For  details  see  [6].  □ 

Remark  3.3.  Equations  (3.13)-(3.18)  are  the  standard  optimal  projection  equations  for 
reduced-order  dynamic  compensation  given  in  [6]. 

Finally,  we  present  a  partial  converse  of  the  necessary  conditions  that  guarantee  closed-loop 
stability. 

Corollary  3.2.  Suppose  there  exist  non  negative-definite  matrices  P,  Q,P,  and  Q  satisfying 
(3.13)-(3.18)  and  let  Ac,  Pc  and  Cc  be  given  by  (3.12).  Then  the  compensator  (.4c,  PcCc)  is  an 
extremal  of  the  optimal  fixed-order  dynamic  compensation  problem,  furthermore  the  following  are 
equivalent: 

A  is  asymptotically  stable;  (3.21) 

(A,  D)  is  stabilizable;  (3.22) 

(A,  E)  is  detectable.  (3.23) 

In  addition, 

{Ac- Be)  is  controllable  if  and  only  if  Ac  +  BcCG'^  is  asymptotically  stable,  (3.24a) 
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(Ac,  Cc)  is  observable  if  and  only  if  Ac  +  fBCc  is  asymptotically  stable. 


(3.246) 


Proof.  That  the  compensator  (Ac,Bc,Cc)  is  an  extremal  follows  immediately  from  the  proof 
of  Theorem  3.1.  It  follows  from  the  proof  of  Corollary  3.1  that  if  nonegative-definite  P,Q,P  and 
Q  satisfy  (3.13)-(3.18)  and  the  compensator  (Ac,Bc,Cc)  is  given  by  (3.12),  then  (independent  of 
the  stability  of  A)  there  exist  n  x  n  real  matrices  P  and  Q  satisfying  (2.11),  (2.12)  and  having 
partitioned  forms  (2.15),  (2.16)  with  the  partitions  satisfying 


Pi  =  P+P,  Qi=Q  +  Q, 

(3.25a, 6) 

Pn  =  -PG-T,  Qi,  =  QpT, 

(3.2.5c,  d) 

P2  =  GPG^,  Q2  =  PQP'^ 

(3.256,/) 

It  then  follows  that  P  and  Q 

can  be  expressed  as 

^=[0  + 

(3.26) 

®=[o  + 

(3.27) 

and  thus 

P  >  0,  (5  >  0. 

(3.28) 

Obviously  (3.21)  impbes  (3.22)  and  (3.23).  Conversely,  using  (2.11)  and  (2.12)  it  follows  from 
Lemma  12.2  of  [19]  that  (3.22)  and  (3.23)  imply  (3.20).  Next,  it  follows  from  (3.25f)  that  the  (2,2) 
block  Q2  of  Q  satisfies 

Q2  =  PQP^  >  0.  (3.29) 

Furthermore,  as  shown  in  the  proof  of  Theorem  3.1,  Q2  satisfies 

0  =  (Ac  +  BcCG'^)Q2  +  Q2(Ac  +  BcCG'^f  +  BcV^Bj.  (3.30) 

The  equivalence  (3.24a)  then  follows  from  (3.29),  (3.30),  Theorem  3.6  and  Lemma  12.2  of  [19].  The 
proof  of  (3.24b)  follows  in  similar  fashion  by  noting  that  P2  =  GPG^  >  0  and  Po  satisfies 

0  =  (Ac  +  PBCcfPi  +  P2(Ac  +  PBCc)  +  CJR2Cc.  □ 
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4.  Optimality  Conditions  for  Full-Order  Dynamic  Compensation 

In  this  section,  we  restrict  our  attention  to  n ‘'“-order  compensators.  Specifically,  we  show  that 
even  when  the  compensator  is  nonminimal,  the  generalized  fixed-order  equations  of  Theorem  3.1 
always  yield  the  standard  LQG  observer  and  regulator  Riccati  equations.  We  also  show  that  a 
corresponding  set  of  mutually  coupled  equations  also  exist  that  are  identical  in  form  to  standard 
optimal  projection  equations  but  characterize  the  same  compensator  as  obtained  from  the  standard 
LQG  Riccati  equations.  The  proofs  of  these  results  rely  on  the  balanced  basis  described  in  the 
following  lemma. 

Lemma  4.1.  Consider  the  closed-loop  system  defined  in  (2.3).  Suppo.se  Uc  =  n  and  P  and  Q 
are  defined  as  in  (2.36)  and  (2.37)  with 


and 


If 


rank  P  =  rank  Fo  =  ^p, 
rank  Q  =  rank  Q2  =  ng, 

rank  QP  =  rank  Q2P2  =  ttr 

+  P2Q2  =  0, 


then  there  exists  a  nonsingular  ra  X  n  matrix 


5  = 


5i  0 

0  S2 


,  5i,52  elR^ 


such  that 


SjPSi  =  SJP2S2  = 


=  S:^^Q2S^'^ 


wiieitr  Uf  —  n  --  yup  T  iCq  —  )  ctiiu  , 

are  diagonal  and  positive  definite. 


S)  On, 

x(np-nr)  On, 

X  ( tr.,  71, ) 

On,  xn, 

Lp— Tlr)XTl,. 

S2 

0 

0 

-nr)xnr 

0 

0 

0 

On,  Xn^ 

0 

0 

0  . 

El 

On,  X(Tlp  ^r) 

On,  x(n,  — n 

p)  On^  xn,  1 

0(np-nr)xnr 

0 

0 

0 

0(n,,  -nr)xnr 

0 

S3 

0 

On,  xn^ 

0 

0 

0 

- 

Cl  G  IR 

E2  e  ir'"^'” 

r  )  X  (  Tip  n^  ) 

,  E3  €  IR^"^ 

(4.1a) 

(4.16) 

(4.1c) 

(4.2) 

(4.3) 


(4.4a) 


(4.46) 
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Proof.  It  follows  from  (4.2)  and  statement  (n)  of  Lemma  2.5  that  Qp  and  Q2P2  have  the  same 
non-zero  eigenvalues.  Thus  using  statement  (iv)  of  Lemma  2.4  and  the  rank  conditions  specified  in 
(4.1),  yields  (4.4a)  and  (4.4b).  □ 


Below,  unless  otherwise  specified,  all  the  nx  n  partitioned  matrices  have  the  same  sub- matrix 
dimensions  as  in  (4.4).- 

Definition  4.1.  Suppose  the  closed-loop  system  (2.3)  satisfies  the  conditions  of  Lemma  4.1  and 
is  transformed  via  the  similarity  transformation  5  given  by  (4.3)  so  that  the  new  closed-loop  states 
are  given  by  x'{t)  =  S~'^x(t),  and  hence  the  transformed  plant  triple  and  compensator 

triple  {A'c,  are  given  by  A'  —  S’fMS'i,  B'  =  S^^B,  C  =  CSi,  and  A'^  =  S2^AcS2,  B[  = 

$2^ Be,  C'e  =  CcSo.  Furthermore,  let  the  transformed  closed-loop  covariance  Q'  and  its  dual  P'  be 
given  by  Q'  =  P'  =  PS,  so  that 


rSi 

0 

0 

0- 

rSi 

0 

0 

0- 

0 

S2 

0 

0 

t  ^  i 

0 

0 

0 

0 

7: 

II 

II 

0 

0 

0 

0 

II 

»o  ' 

11 

0 

0 

LI3 

0 

.  0 

0 

0 

0- 

.  0 

0 

0 

0. 

Then  the  transformation  S  is  called  a  strictly  balanced  transformation  and  the  transformed  coordi¬ 
nates  x'  are  called  strictly  balanced  coordinates. 


Definition  4.2.  Suppose  the  closed-loop  system  (2.3)  is  transformed  via  a  similarity  trans- 
■51  0 


formation  S  =  ^  >  where  Si  is  as  in  (4.4)  so  that  the  new  closed-loop  states  are  given  by 

0 

x'{t)  In  this  case,  the  transformation  5  is  called  a  balanced  transformation  and  the 

transformed  coordinates  are  called  balanced  coordinates. 


Theorem  4.1.  Let  nc  =  n.  Then  there  exist  n  x  n  nonnegative  definite  matrices  Pl^Ql^Pl, 
and  Q I  such  that  an  admissible  extremal  of  the  full-order  dynamic  compensation  problem  is  given 
by: 


Acl^A^  EPl  -  QlS,  (4.6a) 

BcL  =  QLC'^y2~\  (4.66) 

CcL  =  (4.6c) 

where  Pi  and  Qi  are  the  unique,  nonnegative  definite  solutions  respectively  of 

0  =  A^Pi  +  PlA  +  -  Pl^Pl,  (4.7) 
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0  =  AQi  +  QlA^  +  Vi  —  Ql^Ql^ 


(4.8) 


and  Pi  and  Qi  satisfy 

0  =  (^  -  Qi^^fPi  +  Pl{A  -  Qit)  +  PiT.Pi,  (4.9) 

0  =  (A  -  TPi)Qi  +  Ql{A  -  TPif  +  QitQi.  (4.10) 

In  this  case,  the  minimal  cost  is  given  by 

J{A,,Bc,Cc)  =  lr[Pi\\^QiPiTPi],  -  (4.11) 

or,  equivalently, 

J(Ae,  Be,  Ce)  =  triQiR^  +  PiQi^Qi].  .  (4.12) 

Proof.  The  proof  is  constructive  in  nature  and  follows  from  Theorem  3.1  by  choosing  A'  = 
QlC'^V2~\  Y  =  R^^B'^Pl,  and  Z  =  A  -  Qit  -  TPi.  For  details  see  [14].  □ 

Remark  4.1.  Note  that  (4.7)  and  (4.8)  are  the  standard  decoupled  regulator  and  observer 
Riccati  equations  and  {Aci,  Bcl,Ccl)  represents  the  LQG  compensator  (minimal  or  nonmini- 
mal)  obtained  through  the  fixed- structure  approach.  Furthermore,  note  that  equations  (4.9)  and 
(4.10)  are  superfluous  since  the  optimal  compensator  only  depends  upon  the  variables  Pi  and  Qi- 
However,  using  (4.6)  it  can  be  easily  shown  that  Pi  and  Qi  are  observability  and  controllability 
Gramians  of  the  compensator  [10]. 

Corollary  4.1.  Suppose  the  compensator  obtained  in  Theorem  4.1  is  nonminimal.  For  con¬ 
venience,  let  Tiq  =  rank  Qi,  Up  =  rank  Pi  and  iir  =  rank  QiPi-  Then  the  compensator  matrices 
in  the  balanced  coordinates,  A'(^i^,B'ci,Cci,  have  the  following  structure: 

^CL.12  0  0 

0  0  0  0 

"^CL,31  ^CL,32  ® 

0  0  0  0 

■B'ciy 

B'ci  =  J  ,  (4.136) 

^CL,Z 

L  0  J 

—  ^'cL.2  ®  0]’  (4.13c) 


(4.13a) 
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where 


CcL.i  e  IR”'’'”%C^l,2  e 


Proof.  The  proof  is  a  direct  consequence  of  Theorem  4.1  and  relies  on  transforming  the 
compensator  (4.6)  into  strictly  balanced  coordinates.  □ 

Next,  using  the  balanced  transformation  presented  in  Definition  4.1,  we  show  that  the  input- 
output  map  of  the  nonminimal  LQG  compensator  given  by  (4.6)  or,  equivalently,  (4.13)  is  equivalent 
to  the  input-output  map  of  a  specific  compensator  of  Theorem  3.1  with  A'  =  0,  1'  =  0,  Z  =  0 
and  Uc  =  n,  which  we  shall  call  the  full-order  central  compensator  or  the  full-order  least-squares 
compensator.  In  this  case,  as  shown  in  the  next  theorem,  the  resulting  optimality  conditions  are 
identical  in  structure  to  the  standard  optimal  projection  equations  given  by  Corollary  3.1. 

Theorem  4.2.  Let  =  n  and  let  n/  represent  the  order  of  the  minimal  realization  of  the  LQG 
controller.  Suppose  rank  Qo  =  rank  P2  =  rank  Q2P2  =  where  Q2  €  and  Po  €  IR”^"  are 

respectively  the  closed-loop  covariance  of  the  controller  states  and  its  dual.  Then  there  exist  n  x  n 
nonnegative-definite  matrices  P,Q,P.  and  Q  such  that  an  extremal  of  the  full-order  compensation 


problem  is  given  by 

A,  =  Pf(^  -  QS  -  SP)Gj,  (4.14«) 

Bc  =  rpQC^y-r^:  (4.146) 

Cc  =  PGl,  (4.14c) 

where  P.,Q,P,  and  Q  satisfy: 

0  =  A'^P  +  PA-hPi -PSP  +  rJPSPrx,  (4.15) 

0  =  AQ  +  QA^ +  Vi-QtQ  +  TxQtQTl,  (4.16) 

0  =  (.4-QS)'^P  +  P(A-QS)+PSP-rJPEPri,  (4.17) 

0  =  (A  -  SP)g  -h  g(A  -  SP)T  +  QEQ  -  rxgsgrj,  (4.18) 

rank  Q  =  rank  P  =  rank  QP  =  Ur,  (4.19) 
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r  =  (QP)(QPf. 


(4.20) 


and  {Gr,MF,rF)  is  a  n‘'^-order  generalized  projective  factorization  of  QP.  In  addition,  the  cor¬ 
responding  cost  is  given  by 

J{Ac,Bc,Cc)  =  tT[PV,  -b  Q(PEP  -  rjFSPrx)],  (4.21) 

or,  equivalently, 

J(A,,B,,Co)  =  tr[QR,  +  PiQtQ  -  rxC?SQrJ)].  (4.22) 

Furthermore,  suppose  that  the  compensator  is  nonminimal,  i.e.,  n/  <  n,  the  minimal  dimension  of 
the  full-order  central  compensator  is  the  same  as  that  of  the  LQG  compensator,  i.e.,  t?/  =  7!.r-  and 
that  the  LQG  compensator  matrices  for  this  plant  in  the  balanced  coordinates  are  as  in  (4.13)  of 
Corollary  4.1.  Then,  in  the  balanced  coordinates,  a  central  controller  triple  [A[,B[.C[)  is  given 
by: 

r  "^CL.ii  0  0  0 

,  _  0  0  0  0 

^  "  0  0  0  0 

.  0  0  0  0 

-B'cLy 

B[=  Q  ,  (4.236) 

.  0  . 

C'c  =  [C'ci,^  0  0  0],  (4.23c) 

where  i  Corollary  4.1. 

Proof.  The  proof  is  similar  to  the  proof  of  Theorem  3.1  with  ric  =  n  and  A'  =  0.1'  =  0.  Z  =  0. 
Additionally,  the  compensator  (4.23)  is  a  direct  consequence  of  a  balanced  transformation.  □ 

Remark  4.2.  Suppose  the  full-order  compensator  is  minimal  which  implies  rank  Q  =  rank  P 
=  rank  QP  -  n,  or,  equivalently,  r  =  {QP){QP)'^  =  Then,  (4.15)-(4.18)  reduce  to  (4.7)- 
(4.10).  Furthermore,  it  follows  from  the  identity  Pf  Gf^  that  {Ac,  Bc,Cc)  of  (4.14)  is  simply 
some  similarity  transformation  of  the  LQG  controller  triple  (Acl,  Bcl,Ccl)  in  (4.6). 

Remark  4.3.  Suppose  the  LQG  compensator  is  nonminimal.  It  can  easily  be  shown  using  the 
balanced  realizations  that  the  LQG  controller  (4.13)  and  the  fuU-order  central  controller  with  the 
same  minimal  dimension  (4.23)  have  the  same  input-output  map  (but  are  not  equivalent  within  a 
change  of  basis).  Furthermore,  they  have  the  same  input-output  map  as  an  extremal  of  the  optimal 
reduced-order  compensator  problem  with  =  nt- 


(4.23c) 
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Next,  we  prove  that  the  optimal  reduced -order  controller  is  also  a  projection  of  a  full-order 
central  controller  whose  minimal  dimension  is  the  same  as  the  dimension  of  the  optimal  reduced- 
order  controller. 

Theorem  4.3.  Suppose  Uc  <  ni  in  Theorem  4.2.  Then  a  n'^'-order  optimal  compensator 
given  by  Corollary  3.1  can  be  attained  through  a  projection  /z  =  Q2fP2f{QifP2f)*  of  a  full- 
order  central  compensator  with  minimal  dimension  ric,  where  Q^f  ^tid  P2F  a^re  respectively  the 
closed-loop  covariance  of  the  full-order  central  controller  states  and  its  dual. 

Proof.  Let  in  Theorem  4.2  and  note  that  (4.15)-(4.20)  are  identical  to  (3.13)-(3.18) 

which  implies  that  P,  Q,  P,  Q  and  r  are  identical  for  a  full-order  central  compensator  and  a  r?''’-order 
compensator  obtained  from  Corollary  3.1. 

Next,  let  Q2F  and  P2F  be  respectively  the  closed-loop  covariance  of  the  full-order  central  con¬ 
troller  states  and  its  dual.  Since  Q2F  ^  ^iP2F  ^  Oj  and  rank  Q2F  —  rank  P2F  =  rank  Q2FP2F  — 
Tic,  it  foUows  from  Definition  2.3  and  [17]  that  there  exists  a  projective  factorization  {Tj ,Mr,Lr) 
with  Tr  G  IR”^"'%Pr  €  and  Mr  €  such  that 

Q2FP2F  =  TrMrLr,  (4.24) 

PrT.  =  (4.25) 

1^  =  Q2fP2f{Q2fP2f)*  =  TrLr,  (4.26) 

and  /I  is  a  n  X  n  projection  matrix. 

Now  it  follows  from  (A. 4)  and  the  identities  Gf  =  Q2QJ21  ^F  =  Q2P2-,  and  Pf  =  — Po^Pi^, 

that 

LrPFGlTr  =  LrP^FP^FQ2FQlFTr-  (4-27) 

Next,  noting  the  property  of  the  projective  factorization  that  TZ{Lj)  =  TZ{P2f)  TZ{Tr)  = 
P'{Q2F)’i  it  follows  from  property  (u)  of  Lemma  2.1  that  PrP^pP'iF  =  Lt  and  Q2FQ2FPr  =  Pr- 
Using  (4.25),  (4.27)  can  be  rewritten  as 

LrPFGlTr  LrTr  =  In..  (4.28) 

In  addition,  using  (4.26)  and  Q2fP2f{Q2fP2f)*Q2fP2F  =  Q2FP2F  •,  yields 

TrLrMpTrLr  =  Q2FP2F  =  Mf-. 
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which  implies 


GlTrLrMFTrLrBF  =  GJMfBf  =  QP- 

(4.29) 

Thus,  it  follows  from  (4.28)  and  (4.29)  that  {TjGF‘,BrMFTr,LrrF)  is 
of  Qp.  Hence,  using  Corollary  3.1,  {Ar,Br,Cr)  with 

a  projective  factorization 

Ar  =  LrPpiA  -Qt-  EF)G^r,., 

(4.30a) 

Br  =  LrPFQC^V^P 

(4.306) 

Gr  =  R2'^B'^  PGlTr. 

(4.30c) 

is  a  72^^-order  optimal  compensator.  However,  noting  (4.14),  {Ari  BryCr)  can  also  be  expressed  as 
{LrAcTr,LrBc,CcTr).  Tlius,  it  follows  from  (4.23)  and  (4.24)  that  a  n‘'‘-order  optimal  compen¬ 
sator  {Ar^Br^Cr)  Can  be  obtained  through  the  projection  ^  of  a  full-order  central  compensator 
{A,,B,,Cc).  □ 


The  balanced  controller  reduction  method  of  [10]  characterizes  the  reduced-order  controller  by 
a  projection  of  the  LQG  controller.  For  the  special  case  in  which  the  LQG  controller  is  nonmini- 
mal  and  the  requested  dimension  of  the  reduced-order  controller  equals  the  minimal  dimension  of 
the  LQG  controller,  i.e.,  ric  =  n;,  this  method  is  capable  of  producing  a  minimal  representation 
of  the  LQG  compensator.  For  this  special  case,  the  following  theorem  explicitly  defines  the  re¬ 
lationships  among  the  projection  matrix  u  used  by  the  suboptimal  balanced  controller  reduction 
method,  the  projection  matrix  /j  given  by  Theorem  4.3  through  which  a  central  compensator  of 
rank  ni  is  projected  into  a  n[^‘-order  optimal  compensator  and  the  optimal  projection  matrix  r  from 
standard  optimal  projection  theory.  To  facilitate  the  exposition  of  the  following  theorem,  following 


Definitions  4.2  and  4.1.  let 


Si.L  0 
0 


denote  the  balanced  transformation  of  the  closed-loop 


system  using  the  LQG  compensator  and  let 


‘5'i,c 

0 

and 

Sl,c 

0 

0 

‘S'l.c. 

0 

S2.C . 

denote  respectively  the 


balanced  transformation  and  strictly  balanced  transformation  of  the  closed-loop  system  using  the 
appropriate  central  compensator  of  rank  n/. 


Theorem  4.4.  Suppose  {Acl-.Bcl.Ccl)  is  a  nonminimal  LQG  compensator  with  minimal 
dimension  n;  and  (Ac,£c?Cc)  is  a-n  appropriate  central  compensator  with  rank  n/.  Let  v  and 
he  n  X  n  projection  matrices  of  rank  n;  and  L^,,  G  and  G  satisfy 

i'  -  TtyLty,  i-i  =  and  =  /n,-  Suppose  that  {L^AcLTi,.LuBcL^CcLT,y)  and 

{L^AcTf^,  L^BciCcT^)  are  minimal  realizations  of  [Acl^Bcl-Ccl]-  Then 

P^T-^iT.  (4.31) 
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where  T  =  [52,c-  In  addition, 


1/  =  W-'^rVV, 


(4.32) 


where  W  =  5j  J^5i,c. 

Proof.  The  LQG  compensator  triple  in  balanced  coordinates,  =  S^iAclSi,l~  ~ 

S^iBcli  =  CclSi,l)  IIS'S  the  expression  as  in  (4.13).  Using  (4.13),  the  minimal  represen¬ 
tation  of  the  LQG  controller  in  balanced  coordinates  is  (>lcz.,ii  ’ -^CL,]  ’  ^CL.i )  "'h'ch  implies  that 
u'  =  p  in  balanced  coordinates  and  =  [/„,  0],  and  Tl  =  [/„,  0]^  is  a  factorization  of 

v' .  Thus,  using  the  following  identities 

■^C’L,n  ~  —  L'u^\XAclS\,lTI  =  L^AclTu, 

B'cLa  ^  =  L',S-XBcl.  and  =  C'c^Tl  =  CclSi^lK.. 

yields 

L,  =  L',S-X,  T,  =  S,,lTI., 

and 

=  Si,L^'S-l  =  5i,l  [^J'  o]  (4.33) 

Next,  noting  (4.4)  and  using  properties  {in)  and  (zt^)  of  Lemma  2.4,  we  obtain 

v  =  {QlPl){QlPl)*-  (4.34) 

Now,  according  to  Remark  4.3,  a  nj^-order  optimal  controller  obtained  from  (3.12)-(3.18)  has 
the  same  input-output  map  as  the  LQG  controller  whose  minimal  dimension  is  u;.  Thus,  using  the 
special  case,  Uc  =  n;,  of  Theorem  4.3,  yields 

=  iQ2FP2F)iQ2FP2F)*  ,  (4.35) 

where  Q2F  and  P2F  are  respectively  the  closed-loop  covariance  of  the  appropriate  n^-rank  central 
controller  states  and  its  dual.  Now  it  follows  from  Definition  4.1  that 

M  =  52.c  I  S,:}.  (4.36) 

Finally,  following  (4.20)  and  Definition  4.2,  yields 

t  =  QP{QP)*  =  I  (4.37) 

Using  (4.33).  (4.36)  and  (4.37),  yields  (4.31)  and  (4.32).  □ 
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5.  Numerical  Solution  of  the  Coupled  Design  Equations  and  Illustrative  Results 

One  of  the  principal  motivations  for  the  Riccati  equation  approach  to  reduced-order  dynamic 
compensation  is  the  opportunity  it  provides  for  developing  efficient  computational  algorithms  for 
control  design.  In  particular,  the  goal  has  been  to  develop  numerical  methods  which  exploit  the 
structure  of  the  Riccati  equations.  It  turns  out  however,  that  methods  for  solving  standard  Riccati 
equations  cannot  account  for  the  additional  terms  appearing  in  the  modified  equations  of  Theorem 
3.1  and  Corollary  3.1.  Therefore,  a  new  class  of  numerical  algorithms  has  recently  been  developed 
based  upon  homotopic  continuation  methods.  These  methods  operate  by  first  replacing  the  orig¬ 
inal  problem  by  a  simpler  problem  with  a  known  solution.  Specifically,  the  simpler  problem  can 
be  chosen  to  correspond  to  a  low  authority  full-order  LQG  control  problem.  As  shown  in  [20], 
if  the  weighting  matrices  are  chosen  properly,  then  in  this  case  the  LQG  compensator  is  nearly 
nonminimal.  Hence,  using  a  simple  balanced  controller  reduction  technique  [10],  the  resulting  bal¬ 
anced  reduced-order  controller  serves  as  a  good  approximation  to  the  optimal  projection  controller 
corresponding  to  the  simpler  problem.  The  desired  solution  is  then  reached  by  integrating  along  a 
path  which  connects  the  starting  problem  to  the  original  problem.  These  ideas  have  been  recently- 
illustrated  for  the  reduced-order  control  problem  in  [13,  14]. 

Using  the  homotopy  algorithm  appearing  in  [13]  we  demonstrate  the  utility  of  the  Ho  optimal 
reduced-order  controller  design  framework  discussed  in  this  paper  on  the  four-disk  axial  beam 
problem  shown  in  Figure  5.1.  This  example  was  derived  from  a  laboratory  experiment  [21]  and  has 
been  considered  in  several  subsequent  publications  (e.g.,  [22-24]).  The  8^^-order  state  space  model, 
problem  data,  and  design  weights  are  given  in  the  above  references.  The  basic  control  objective  for 
the  four-disk  problem  is  to  control  the  angular  displacement  at  the  location  of  disk  1  using  a  torque 
input  at  the  location  of  disk  3.  It  is  also  assumed  that  a  torque  disturbance  enters  the  system  at 
the  location  of  disk  3. 

The  design  philosophy  adopted  here  is  that  the  scaling  92  of  the  nominal  control  weight  ^2,0=  1 
and  the  nominal  sensor  noise  intensity  ¥2,0  =  1,  where  the  subscript  “0”  denotes  initial  values,  are 
simply  “design  knobs”  used  to  determine  the  control  authority.  Hence,  R2{¥)  =  q2{^)R2fi  and 
V2(A)  =  92(A)U2,o,  where  A  is  a  homotopy  parameter  and  A  €  [0, 1).  Here,  we  consider  the  design 
of  2"‘^,4‘*,  and  -order  controllers  for  various  authority  levels. 

Since  at  q2  =  10,  the  2”*^,  4*^,  and  6*^  balanced  reduced-order  controllers  are  all  good  approxi¬ 
mations  of  the  corresponding  reduced-order  optimal  controllers,  we  use  these  suboptimal  controllers 
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to  initialize  the  homotopy  algorithm  and  deform  the  controllers  into  the  higher  authority  optimal 
controllers  corresponding  to  72  =  1-  In  each  of  the  following  passes,  we  increase  the  authority  level 
by  decreasing  R2  and  V2  by  a  factor  of  10,  i.e.,  92, next  ==  0.1^2,05  ^nd  at  the  end  of  each  pass  de¬ 
form  the  initial  optimal  controllers  to  the  optimal  controUers  corresponding  to  the  higher  authority 
level.  This  process  is  repeated  for  every  reduced-order  design.  Figure  5.2  compares  the  optimal 
controllers  of  various  orders.  This  type  of  figure  can  be  used  in  practice  to  determine  the  order  of 
the  controller  to  be  implemented. 

The  Frobenius  norms  of  P,  Q,  P,  and  Q  are  also  recorded  along  the  homotopy  path  and  typical 
results  are  shown  in  Figure  5.3  of  ||P||f  for  the  4^^>order  controller  design.  It  is  interesting  to 
note  that  as  the  control  authority  is  increased  beyond  a  certain  level  (e.g.,  for  71^  =  4,^2  <  10“"^) 
those  values  approach  some  stable  limit  as  indicated  in  this  figure.  This  is  because  P,Q,I\  and  Q 
converge  to  fixed  values  as  the  control  authority  increases.  It  follows  that  the  optimal  reduced-order 
controller  converges  to  a  fixed  value. 

6.  Conclusion 

Necessary  conditions  for  fixed-structure  H2  optimal  control  were  derived  without  assuming 
compensator  minimality.  These  necessary  conditions  are  characterized  in  terms  of  coupled  Riccati 
and  Lyapunov  equations  which  reduce  to  the  optimal  projection  equations  [6]  when  the  compensator 
is  minimal.  The  standard  LQG  Riccati  equations  can  also  be  derived  when  the  optimality  conditions 
are  specialized  to  the  full-order  case.  Furthermore,  it  is  shown  for  the  first  time  that  a  reduced-order 
optimal  projection  controller  is  a  projection  of  a  “central”  extremal  of  the  corresponding  full-order 
compensation  problem.  For  nonminimal  LQG  compensators,  balanced  controller  reduction  method 
is  able  to  produce  a  minimal-order  realization  of  the  LQG  compensator.  For  this  special  case,  the 
relationships  between  the  projection  matrix  used  by  balanced  controller  reduction,  the  projection 
matrix  through  which  an  appropriate  central  controller  is  projected  into  a  reduced-order  optimal 
controller  whose  dimension  is  the  same  as  the  minimal  dimension  of  the  LQG  controller,  and  the 
optimal  projection  matrix  from  the  standard  optimal  projection  theory  are  explicitly  defined.  A 
continuation  algorithm  that  exploits  the  Riccati-equation  design  framework  is  discussed  and  its 
utility  for  controller  synthesis  is  illustrated  using  a  representative  problem  in  structural  control. 
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Appendix  A.  Proof  of  Theorem  3.1 

To  optimize  (2.14)  over  the  open  set  Sc  subject  to  the  constraint  (2.11),  form  the  Lagrangian 

£(ylc,5e,C.,g,P,A)  4  tr[XQR  +  {AQ  +  QA^  +  V’)P],  (Al.l) 

where  the  Lagrange  multipliers  A  >  0  and  P  G  are  not  both  zero.  We  thus  obtain 

^  =  A'^P  +  PA  +  XR. 

OQ 

Setting  dCjdQ  -  0  yields 

0  =  ^^P+  P^  +  AP, 

or,  equivalently, 

(^^©A^)  vec  P  = -A  vec  R,  {A.2) 

where  ©  denotes  the  Kronecker  sum  and  “vec”  is  the  column-stacking  operation  defined  in  [25]. 
Since  A  is  assumed  to  be  asymptotically  stable,  (i'^  ©  A^)  is  invertible,  and  thus  A  =  0  implies 
P  =  0.  Hence,  it  can  be  assumed  without  loss  of  generality  that  A  =  1,  which  yields  (2.12). 
Furthermore,  with  A  =  1,  (A. 2)  is  equivalent  to 

P  =  _vec'^[(i'^  ©  yi'^)“^vec  Pj. 

To  prove  that  P  is  nonnegative  definite,  we  rewrite  the  above  expression  as 

OO 

P  =  j  vec”^  R]  di, 

0 

and  show  that  the  integrand  is  nonnegative  definite  for  all  t  G  [O.oc).  For  convenience,  let  5  and 
N  he  n  X  n  matrices  with  i\'  >  0.  Since  (see  [25]) 

,ses  ^  ^ 

and 

vec“'^[(5  0  5)vec  iV]  =  >  0, 

wdiere  0  denotes  the  Kronecker  product  defined  in  [25].  it  follows  that 

vec"'^[e‘^®*^vec  A']  ==  vec“^[(6‘^  0  e‘^)vec  A^]  =  N >  0. 
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Noting  R  is  nonnegative  definite  and  applying  the  above  expression  wdth  (A. 3)  it  follows  that  the 
integrand  of  (A. 3)  is  nonnegative  definite.  Thus  P  is  nonnegative  definite. 


Now  partition  fi  x  ft  P,Q  into  nx  Ti,nx  Tie,  and  tiq  x  tIq  subblocks  as  in  (2.16)  and  (2.15), 
respectively.  The  stationary  conditions,  with  A  =  1,  are  then  given  by 

dc 


OAr 


=  PuQn  +  P2Q2  =  0, 


dC 

dBc 

dC 


=  P2BCV2  +  (Pi^2^?l  +  P2QJ2)C^  = 


dCc 


=  -R2CCQ2  +  B'^[P,Qn  +  A2Q2)  =  0. 


(A.4) 

(A.5) 

(A.6) 


Expanding  (2.11)  and  (2.12)  yields  (2.17)-(2.22).  Since  A  is  assumed  to  be  asymptotically  stable, 
using  (2.28b)  and  (2.29a)  of  Lemma  2.3  we  can  rewrite  (A.4)  as 


P2(In.  +  P2^P^2Qi2Q2)Q2  =  0. 


(.4.7) 


Next,  define  the  n  x  n  matrices 


P  =  Pi  -  PuP^Pu^  Q  =  Ql-  Qi2QIqJ2- 

(A. 8a,  b) 

P  =  Pl2P2^Pa'"2,  Q^Ql2QlQj2, 

(A.9a,6) 

and  Tic  X  n,  Tic  X  ric,  and  Uc  X  n  matrices 

G  =  QlQj,,  M  =  Q2P2,  P  =  -P^Pn- 

(A. 10a,  b,  c) 

Note  that  the  definitions  of  P,  Q.  G,  M  and  P  in  (A. 9)  and  (A. 10)  are  identical  to  the  ones  defined  in 
(2.41)-(2.45)  of  Lemma  2.5.  Furthermore,  noting  that  (A.4)  is  equivalent  to  (2.46),  it  follows  from 
the  property  (ii)  of  Lemma  2.5  that  (G,  M,  P)  satisfies  property  (v)  of  Lemma  2.4,  or,  equivalently, 
{G,M,P)  is  a  generalized  projective  factorization  of  QP.  Clearly,  P.Q.P  and  Q  are  symmetric 
and  P  and  Q  are  nonnegative-definite.  To  show  that  P  and  Q  are  also  nonnegative  definite,  note 
that  P  is  the  upper  left-hand  block  of  the  nonnegative-definite  matrix  VPV'^,  where 


V  = 


In  -PuP^. 

LOti^XTI  Iuc 


Similarly,  Q  is  nonnegative  definite.  Next,  using  the  properties  of  the  Moore-Penrose  generalized 
inverse,  it  is  helpful  to  note  the  following  identities  from  the  definitions  (A.8)-(.4..10): 


p  =  -p,,p  =  =  P'^P2r, 


(A.lla) 
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Q  =  Q^2G  =  G'TqT  =  C'^Q2G, 

(/1. 11/;) 

and 

P=Pi-P,  Q  =  Qi-Q. 

(A.12fl.6) 

In  addition,  using  (2.23)  and  (2.24)  yields 

PT  =  -P^P,  P12  =  -P'"P2. 

(A.13) 

Qi2  =  Q2G,  Qn  =  C^C2- 

(A.14) 

Furthermore,  it  follows  from  (A. 2)  that 

QP  =  ~Ci2Pi'2' 

(.4.15) 

Next,  using  (A.  13),  we  can  rewrite  (A. 7)  as 

-  rG'^)Q2  =  0.  (A.16) 

Forming  using  (A. 9a)  and  (2.28a)  of  Lemma  2.3,  yields 

PQi2  +  A2Q2  =  0.  (A. IT) 

Similarly,  computing  {AA)Q2Q'i2  using  (A. 9b)  and  (2.29b)  of  Lemma  2.3,  yields 

P^.Q  +  P2QJ2  =  0-  (A-18) 

Using  the  identities  (A. 18)  and  (A. 12a)  we  can  rewrite  (A. 5)  as  P2BCV2  +  =  0.  Noting 

that  V2  is  invertible  and  using  (A. 13)  yields  P2{Bc  -  PQC'^VP^)  =  0.  which  further  implies 

Be  =  PQC^V^-^  +  (/n,  -  P^P2)A',  (A.19) 

where  A"  €  is  an  arbitrary  matrix.  Similarly,  using  (A. 17)  and  (A. 12b)  we  can  rewrite 

(A. 6)  as  —R^CcQ^  +  B'^ PQ22  =  0.  Noting  that  R2  is  invertible  and  using  (A. 14),  yields  (Cc  — 
R2^ B^ PG^)Q2  =  0,  which  further  implies 

Cc  =  Ro^B^PG'^  +  Y{In,  -  Q2QI),  (A.20) 

where  Y  €  is  an  arbitrary  matrix.  Next,  computing  either  (2.21)'^<5i2  +  (2.22)(32  and  using 

(A.4)  and  (A. 6)  or  P)2(2-18)  +  ^2(2. 19)  and  using  (A.4)  and  (A.5),  yields 

P2ACQ2  +  P^2-^Q'^2  +  P2BcCQ\2  ~  P\2PP'  cQ^  —  0- 
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Noting  (A. 13)  and  (A. 14),  the  above  equation  is  equivalent  to 


P2{Ac  -  PAG^  +  BcCG'^  +  rBCc)Q2  =  0.  (A.21) 

Using  identities  (A. 19)  and  (A.20)  and  noting  the  properties  of  the  Moore-Penrose  generalized 
inverse,  (2.23)  and  (2.24),  (A.21)  can  be  rewritten  as: 

P2[Ac-r(A-SP-Q£)G''^]Q2  =  0,  (A.22) 

which  further  implies 

Ac  =  r(/l  -  SP  -  QS)G'^  +  2  -  P^PiZQ.Ql  (A. 23) 


where  Z  £  is  arbitrary. 

However,  it  follows  from  properties  (u),  {Hi),  (v)  and  (vi)  of  Lemma  2.2,  X.Y  and  Z  must  be 
chosen  such  that  the  compensator  triple  {Ac.,Bc,Cc)  satisfies  (3.4),  (3.5),  M^P^)  —  the  unobserv- 
able  subspace  of  (Ac,Cc),  and  A'iQ^)  =  the  uncontrollable  subspace  of  {Ac,Bc),  to  assure  the 
closed-loop  system  stability. 

Furthermore,  since  P2  and  Q2  do  not  necessarily  have  full  rank  and  A^iPt)  C  A'(Pi2)  and 
Af{Q2)  C  AI'{Q\2),  we  may  introduce  additional  singularities  during  the  derivation  for  the  expression 
of  Ac-  The  extra  singularities  can  be  eliminated  by  examining  the  conditions  under  which  the 
original  Lyapunov  equations  (2.17)-(2.22)  are  satisfied.  Since  Ac  is  not  involved  in  (2.17)  and 
(2.20),  only  (2.18),  (2.19),  (2.21)  and  (2.22)  have  to  be  checked.  Using  (2.28)  and  (2.30),  (2.21) 
can  be  rewritten  as 

PisAc  -f  (A'^Pio  +  C'^PjP2  -  PiBCc)P^P2  =  0. 

Using  (2.21)  the  above  equation  can  be  reduced  to  Pi2Ac  —  P12ACP2P2  =  0^  or,  equivalently, 

Pi2Ac(/-P2^P2)  =  0.  (A.24) 

Similarly,  using  (2.28)  and  (2.30),  (2.22)  can  be  reduced  to  (3.2).  Next,  using  (2.29)  and  (2.31), 
(2.18)  and  (2.19)  can  be  reduced  to 

QuA'^il  -QlQ2)  =  (i.  (A.25) 

and  (3.3),  respectively.  Using  the  property  ^’(Po)  C  A^(Pi2),  (3.2)  implies  (.4.24).  Similarly,  with 
A^{Q2)  C  A^iQu),  (3.3)  implies  (A.25).  Furthermore,  note  that  (3.2)  and  (3.3)  also  satisfy  the 
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n6cess3.ry  conditions  for  A  to  be  cLsymptoticcilly  stsible  a-s  stated  in  Lemma  2.2.  Thus  A ,  i  and  Z 
in  (3.1)  must  be  chosen  such  that  Be  and  Cc  satisfy  (3.2)-(3.5). 

Computing  (2.20)  +  (2.21)r  +  r'^(2.21)'^  and  using  (A.lla),  (A. 12a)  and  (A.13),  yields 

0  =  A'^P  +  PA  +  R,-PBCc^-^'^CJB'^P-^'^{A]P,  +  P2A,-P:^,BCc-CJB'^P^2)^.  (A26) 

Using  (2.22)  to  eliminate  the  terms  in  the  parenthesis,  (A.26)  is  equivalent  to 

0  =  A'^ P  +  PA  +  Ri  -  PBCcP  -  P'^ Cj B^ P  +  P'^Cj EiCeP.  (A.27) 

Forming  (A.27)  +  PEP  -  PEP,  and  noting 

{R^^B'^P  -  CcPfR2{R2^B'^P  -  CeP)  =  -PBCcP  -  P'^CJB^P  +  +  PEP, 

yields  (3.6).  Next,  computing  (2.20)  -  (3.6),  using  (A. 12a)  and  noting  the  identity  PnBcC  = 
-P^ P2BcC  =  -PQE,  we  obtain  (3.8).  Similarly,  computing  (2.17)  -  (2.18)6'  -  G'^(2.18)^  and 
using  (A. lib),  (A. 12b)  and  (A. 14)  yields 

0  =  AQ  +  QA'^  +  V,-QC^BjG-G'^BcCQ-G'^{AcQ2  +  Q2Aj  +  BcCQn  +  Qj2C^Bl)G.  (A.28) 
Using  (2.19)  to  eliminate  the  terms  in  the  parenthesis,  (A. 28)  is  equivalent  to 

0  =  AQ  +  QA^  A  Ui  -  QC'^BjG-  G'^BcCQ  +  G^Bc\  2BJG.  (.4.29) 

Forming  (A.29)  +  QEQ  -  QEQ  and  noting 

{QC'^VG^  -  G'^Bc)V2{QC'^y2~^  -  G'^Bcf  =  -QC'^B^.G  -  G'^B.CQ  +  +  QEQ, 

yields  (3.7).  Next,  computing  (2.17)  -  (3.7),  using  (A. 12b)  and  noting  the  identity  = 

G'^Q2CJ B'^  =  QP^',  we  can  obtain  (3.9). 

Finally,  to  prove  (3.10),  using  (2.16)  and  (2.9),  (2.14)  becomes 

J{Ac,Bc,Cc)  =  tr  PiUi  +  tr  (A.30) 

Next,  noting  the  identity  tr  Pofich'^Pj  =  tr  V2BJ P2BC,  and  using  (3.1b)  and  the  fact  that  {I  — 
P2P^)P2  =  P2{I  -  P2P2)  =  0,  yields  tr  PsPcI^^J  =  tr  CQP^  P2PQG'^Vf\  Thus,  using  (A.lla), 
the  above  expression  can  be  reduced  to 

tr  P2Bc\^,BJ  =  tr  CQPQC'^VP^  =  tr  PQG'^Vf^CQ  =  tr  PQEQ.  (A.31) 

Furthermore,  using  (.4.31)  and  (A. 12a),  (.4.30)  is  equivalent  to  (3.10).  Similarly,  using  the  dual 
approach  and  noting  that  J{Ac,Bc,Gc)  =  tr  QR  yields  (3.11).  □ 
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Figure  5.3.  HPHf  as  a  Function  of  Control  Authority  {q^  M  for  Four  Disk 
Example  with  Hc  =  4 
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Abstract 

It  has  been  observed  nimierically  that  suboptimal 
controller  reduction  rnethods  tend  to  work  well  when 
applied  to  low  authority  LQG  controllers.  However,  to 
date,  a  rigorous  justification  for  this  phenomena  has  not 
been  established.  This  paper  shows  that  for  continuous¬ 
time  stable  systems,  by  proper  choice  of  the  structure 
of  the  design  weights,  the  corresponding  LQG  cornpen- 
sator  becomes  nonminimal  as  the  control  authority  is 
decreased.  An  example  illustrates  that  the  near  non¬ 
minimality  of  the  LQG  compensator  can  result  in  near 
optimality  of  the  corresponding  controller  obtained  by 
suboptimal  controller  reduction. 


1.  Introduction 

The  development  of  linear-quadratic-gaussian  (LQG) 
theory  wais  a  major  breakthrough  in  modern  control  the¬ 
ory  since  it  provides  a  systematic  way  to  synthesize  high 
performance  controllers  for  nominal  models  of  complex, 
multi-input  multi-output  systems.  However,  one  of  the 
well  known  deficiencies  of  an  LQG  compensator  is  that 
its  minimal  dimension  is  usually  equal  to  the  dimension 
of  the  design  plant.  This  has  led  to  the  development  of 
techniques  to  synthesize  reduced-order  approximations 
of  the  optimal  full-order  compensator  (i.e.,  controller  re¬ 
duction  methods)  [1-6]. 

The  controller  reduction  methods  almost  always 
yield  suboptimal  (and  sometimes  destabilizing)  reduced- 
order  control  laws  since  an  optimal  reduced-order  con¬ 
troller  is  not  usually  a  direct  function  of  the  parameters 
used  to  compute  or  describe  the  optimal  full-order  con¬ 
troller.  Nevertheless,  the,se  methods  are  computation¬ 
ally  inexpensive  and  sometimes  do  yield  high  performing 
and  even  nearly  optimal  control  laws.  \n  observation 
that  holds  true  about  most  of  these  methods  is  that  they 
lend  to  work  best  at  low  control  authority  [4,  6].  How¬ 
ever.  to  date  no  rigorous  explanation  has  been  presented 
to  explain  this  phenomenon. 

This  paper  provides  a  constructive  way  of  choosing 
the  weights  in  a  LQG  control  problem  of  dimension  n 
such  that  for  a  given  rir,  <  n  the  corresponding  -order 
controller  obtained  by  a  suboptimal  reduction  method  is 
guaranteed  to  have  essentially  the  same  performance  as 
the  LQG  controller  at  low  control  authority.  Although 
the  guarantee  is  for  a  low  authority  control  problem,  it 
is  expected  that,  as  the  control  authority  is  increased 
bv  scaling  the  appropriate  weights,  suboptimal  reduc¬ 
tion  methods  will  perform  belter  than  they  would  with 
another  set  of  weights. 

The  discussion  here  focuses  on  stable  systems.  It 


is  shown  that  if  the  state  weighting  matrix  /?i  or  dis¬ 
turbance  intensity  V'l  has  a  specific  structure  in  a  basis 
in  which  the  A  matrix  is  upper  or  lower  block  triangu¬ 
lar,  respectively,  then  at  low  control  authority  the  corre¬ 
sponding  LQG*  compensator  is  nearly  nonminimal  with 
minimal  dimension  n,-.  It  follows  that  the  LQG  com¬ 
pensator  can  be  easily  reduced  to  a  n^^‘-order  controller 
having  nearly  the  same  performance. 

A  special  case  of  the  conditions  presented  for  R\ 
and  Vx  has  a  strong  physical  interpretation  for  structural 
control  problems.  In  particular,  assume  that  all  of  the 
eigenvalues  in  the  plant  are  complex  and  that  is  an 
even  number.  Then,  either  R\  is  allowed  to  weight  only 
nc/2  modes  or  V"i  is  allowed  to  disturb  only  nr/2  modes. 

Notation 

IR,  real  numbers,  r  x  s  real  matrices, 


E 

expected  value 

A'  >  0 

matrix  A'  is  nonnegative  definite 

A  >  0 

matrix  A'  is  positive  definite 

Orx^.Or 

r  X  s  zero  matrix,  r  x  r  zero  matrix 

Ir 

r  X  r  identity  matrix 

vec() 

the  invertible  linear  operator  defined  as 

vec  5  =  [sj  5?  •  •  5  G 

where  Sj  G  IR^  is  the  column  of  S. 

2.  Low  Authority  LQG  Compensation 

Consider  the  n*^-order  linear  time-invariant  plant 
i(t)  =  Ax(t)  -f  Bu{t)  +  DiudO,  (2. la) 
y{t)  =  Cx(t)^  D^wit).  (2.16) 

where  (A,  B)  is  stabilizable,  (.A.C)  is  detectable,  x  G 
IR”.  u  G  €  IR^  and  w  G  IR*^  is  a  standard  white 

noise  disturbance  with  intensity  Id  and  rank  Do  =  /. 
The  intensities  of  Diw(i)  and  D^wii)  are  thus  given, 

respectively,  by  =  D\Dj  >  0.  and  Vo  =  DoDT  >  0- 

For  convenience,  we  assume  that  V'n  =  DiD7  =  0. 
i.e..  the  plant  disturbance  and  measurement  noise  are 
uncorrelated.  Then,  the  LQG  compensator 

iAt)  =  A,xc{t}  +  Bcyii),  (2.2a) 

u(t)  =  -CcXrAt).  (2.26) 

for  the  plant  (2.1)  minimizing  the  steady-state  quadratic 
performance  criterion 

t 

J(.4c.  S..LV)  =  lim  -E  [ [x'^(s)Rix(sHiJ {s)R.u(s)]ds. 
f-OD  t  J 
0 

(2.-3) 
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where  Ri  >  0  and  Rn  >  0  are  the  weighting  ma¬ 
trices  for  the  controlled  states  and  controller  input,  re¬ 
spectively.  is  given  by: 


(n)  If  A  is  asymptotically  stable,  then  the  unique, 
nonnegative-definite  solution  of  the  Lyapunov 
equation: 


A,zzA-^P-Qt,  (2.4a) 
fi,  =  QC^\,:r ' .  C  =  ‘  P.  (2.46.  c) 


0  =  A'^P  +  PA  +  Ri.  (2.13) 


is  given  by 


where  BRn^  I)  =  and  F  and  Q  are 

the  unique,  nonnegative-definite  solutions  respectively 
of 


0  =  A'^P  +  PA  aR\-  P^P>  (2.5) 

0  =  -4Q  +  g.4'^  +  V  i  (2.6) 

Furtiiermore,  the  “shifted"  observability  and  controlla¬ 
bility  gramians  [1]  of  the  compensator,  P  and  Q,  are  the 
unique,  nonnegative-definite  solutions  respectively  of 

0  =  (A-  QtfPA  P(A  -  Qt)  -b  PEP,  (2.7) 

0  =  (.4  -  EP)(5  +  Q{A  -  EP)'^  +  QtQ.  (2.8) 

Although  a  cross- weighting  term  of  the  form  2ar'^(<)Pi2 
a(i)  can  also  be  included  in  (2.3),  we  shall  not  do  so 
here  to  facilitate  the  presentation.  The  magnitudes  of 
Po  and  Vo  relative  to  the  state  weighting  matrix  R\  and 
plant  disturbance  intensity  V\  govern  the  regulator  and 
estimator  authorities,  respectively.  The  selection  of  R^ 
and  Vo  such  that  IIP2II  >>  l|Pill’  ll^sll  >>  ll^ilh 
yields  a  low  authority  compensator.  This  section  shows 
that  when  the  open-loop  plant  is  stable  and  (A,  Pi)  or 
(A,  V’l )  have  a  particular  structure,  the  LQG  controller 
approaches  nonminimality  as  the  controller  authority 
decreases.  In  order  to  prove  this  result,  we  first  exploit 
some  interesting  structural  properties  of  the  solutions  of 
the  Riccati  equations  and  Lyapunov  equations  assuming 
the  coefficient  matrix  A  and  the  constant  driving  term 
Pi  have  certain  partitioned  forms. 

Lemma  2.1.  Suppose 


,1 


Ai 

A21 


where  Ai,Pi.i  E 


Pi 

Po 


Pi 


Pi,i  0 

0  On  — n  p  ^ 

(2.9a, 6, c) 


,  Pi  G  Pi.i  >  0. 


(/;  If  both  (A,P)  and  (Ai.Pi)  are  stabilizable, 
then  the  unique,  nonnegaiive-definite  solution 
of  the  Riccati  equation: 


0  =  A'^P  +  PA  +  Ri-  PBB'^P,  (2.10) 


is  given  by 


Pi 

0  On-n 


(2.14) 


where  the  Ur  x  rir  matrix  Pi  is  the  unique, 
positive-definite  solution  of 


0  =  .47Pi  +  PiA, +  (2.15) 


Proof. 

{/)  Since  (A,P)  is  stabilizable  and  R\  >  0,  it  fol¬ 
lows  from  Theorem  12.2  of  [7]  that  there  exists  a 
unique,  nonnegative-definite  solution  of  the  Ric¬ 
cati  equation  (2.10).  Similarly,  the  assumptions 
that  (Ai,Pi)  is  stabilizable  and  Pi,i  >  0  im¬ 
ply  that  there  exists  a  positive-definite  matrix 
Pi  satisfying  the  Riccati  equation  (2.12).  Using 
(2.12),  it  follows  by  construction  that  (2.11)  is 
the  solution  of  (2.10). 

(ii)  This  is  a  special  case  of  the  Riccati  equation  of 
property  (i).  □ 

The  following  lemma  states  the  dual  of  Lemma  2.1 
if  the  coefficient  matrix  A  is  upper  block  triangular  and 
V'l  is  upper  block  diagonal. 

Lemma  2.2.  Suppose 


,4 1  y4 1 2 

0  Ao 

,  C  =  [C,  Co],  V’,  = 

V’l.i  0 

0  0„_n.. 

(2.16a,  6,  c 

where  Ai ,  V'l  j  G  CiGlR^^”',  V'l  1  >  0. 


(i)  If  (A,C)  and  (Ai,Ci)  are  detectable,  then  the 
unique,  nonnegative-definite  solution  of  the  fol¬ 
lowing  Riccati  equation: 

0=  AQ  +  QA'^ +Vi-QC'^CQ.  (2.17) 


is  given  by 


Qi 

0 


(2.18) 


where  the  rir  x  Ur  matrix  Qi  is  the  unique, 
positive-definite  solution  of 


Pi  0 


0  On  -  n 


(2.11) 


where  the  Ur  x  Ur  matrix  Pi  is  the  unique, 
positive-definite  solution  of 


0  =  A 1  g  I  +  g  1  aJ  +  v'l  1  —  g  i  cj  c  i  g  i .  (2.19) 

(ii)  If  A  is  asymptotically  stable,  then  the  unique, 
nonnegative-definite  solution  of  the  Lyapunov 
equation; 


0=  AjP:  +  PiA,  +  Ri.i-  PiBiBjPi.  (2.12) 


0  =  .4(3  +  Q.4^  + V,.  (2.20) 
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i^  given  by 


where  the  Ur  x  «r  matrix  Q\  is  the  unique, 
posit ive-definite  solution  of 

u  =  +(?i.-l[  + r,,i.  (2.22) 

Proof.  The  proof  is  dual  to  the  proof  of 
Lemma  *2.1.  □ 

rhe  following  theorem  proves  that  with  proper 
choice^  of  the  weighting  matrices,  a  low  authority  LQG 
controller  for  a  stable  plant  is  nearly  nonminimal.  The 
proof  of  this  theorem  relies  on  the  above  two  lemmas. 

Tlieorem  2.1.  Consider  the  plant  given  by  (2.1). 

(0  Suppose 

Ri.^  0 
0  On-n.  ‘ 

(2.23a.  6) 

wiiere  Ri.i  >  0.  and  .4  is 

asymptotically  stable.  Let 


Q  and  P  are  the  shifted  controllability  aii<i  <;b- 
servability  gramians  of  the  corresponding  I.Q(i 
compensator,  satisfying  (2.8)  and  (2.7).  rasper- 
lively. 


Proof. 


(0 


Partition  B  = 


B. 


and  1)  = 


conformal  to  .4  in  (2*^3).  The  assumptions 
(2.23)  and  that  .4  is  asymptotically  stahh'  imply 
that  (A.B)  and  {A\/B])  are  both  stabilizabh- 
Thus,  it  follows  from  property  (/)  of  Lemma  *2.1 
that  the  unique,  nonnegative-definite  solut  ion  P 
of  the  Riccati  equation  (2.5)  has  the  structure 
given  by  (2.11),  w'hich  implies  that 


PZP  = 


Pi^iPx 

0 


0 

0 


(*2.29) 


Thus,  noting  the  special  partitioned  structures 
in  (2.29)  and  (2.23),  and  that  .4  is  a.^ympioi- 
ically  stable,  it  follows  from  property  (//)  of 
Lemma  2.1  that  there  exists 


Po 


A 

0 


(2.30) 


V,  =  iiVn  (2.24) 

where  lo  is  some  finite,  positive-definite  matrix 
and  E  m  is  a  positive  scalar.  Then  for  any 
6  >  0.  there  exists  N  such  that  for  all  3  > 

(A.,  +  i/AnJ<6,  (2.25) 

where  A,  represents  the  eigenvalue  of  QP, 
At  >  A2  >  ...  >  A,  >  A,>i...  >  0,  and  Q  and  P 
are  the  shifted  controllability  and  observability 
gramians  of  the  corresponding  LQG  compen¬ 
sator,  satisfying  (2.8)  and  (2.7),  respectively. 

(n)  Suppose 


which  is  the  unique,  nonnegative-definite  solu¬ 
tion  of 

0  =  .4^Po+ A.-I  +  PEP.  (2.31) 

where  rir  x  nr  matrix  Pi  is  the  unique,  nonneg¬ 
ative  definite  solution  of  0  =  .47  Pi  4-  Pi -4 1  -1-  Pi 
HiPj.  Next,  computing  (2.31)  -  (2.7)  and  using 
(2.24),  yields  the  following  modified  Lyapunov 
equation: 

0  =  A'^AP  +  APA  +  ;3-^[{toQP)  +  {toQP)'^] 

(2.32) 


VVi  0 

0  On- fir 

(2.26a.  6) 

where  .4i.V'ij  E  IF”"''''".  V\,i  >  0.  and  .4  is 
asymptotically  stable.  Let 

Po  =  0P2.  (2-27) 

where  Po  *s  some  finite,  positive-definite  matrix 
and  a  e'm  is  a  positive  scalar.  Then  for  any 
6  >  0,  there  exists  ;V  such  that  for  all  a  >  N , 

(Anr+l/AflrX^.  (2.28) 

where  A,  represents  the  eigenvalue  of  QP 
aiul  Ai  ^  Ao  ^  •••  ^  A|  ^  Aj^i...  ^  0,  and 


where  £0  =  (2.33a) 

AP=Po-P.  (2.3.36) 

Since  .4  is  asymptotically  stable  and  Q  and  P 
satisfy  (2.6)  and  (2.7),  respectively.  Q  and  P 

are  bounded  for  ail  /?.  Next,  we  rewrite  (2.33b) 
as 

P=Po-d-'APo.  (2..34) 

where  A  A  is  tl>e  solution  of  0  =  .l^APo  + 
APo.4  +  {t,oQP  +  (TIoQP)^)  rewriting 

(2.8)  ^  0  =  (.4  -  LP)Q  +  (?(.4  -  EP)^  ^ 

J“'Q£oQ.  it  follows  that 

Q  =  3-'Qo.  (2.3.3) 


.1  = 


-•li 

0 


-4 12 
.42 


V,  = 
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where  C?o  satisfies  0  =  (.4  -  LP)Qo  +  Qo(--l  - 
+  Q^nQ  Next,  using  (2.3*4)  and  (2.3o). 
we  obtain  (for  large  d) 


.S’  =  QP  = 


d-‘5„ 

■i-'-S-, 


where  ,d|  G  IK"'*"',  .s'-,  £ 

■S'l  is  nonsingular.  Note  that  since  Q  and  P 
are  nonnegative-definite.  .S'  j.s  seinisiinple  and 
the  eigenvalues  of  N  are  real  and  nonnegative. 
Hence,  the  eigenvalue  ratio  of  5  is  the  .same  as 
I  he  corresponding  eigenvalue  ratio  of  3S.  Next, 
define 


and  recognize  that  lim,j_.:c  d5  =  5'.  Noting 
that  the  eigenvalues  of  S'  are  the  collection  of 
n,-  eigenvalues  of  5i  plus  (n  -  nr)  zero  eigenval¬ 
ues.  and  since  the  eigenvalues  of  a  matrix  are 
continuous  with  respect  to  the  parameters  of 
the  matrix,  it  follows  that  for  any  <  >  0.  there 
exists  A’  such  that  for  all  >  JV,  As,  ,  —  c  < 

^JS.i  <  ^s,.i  +  (.  for  i  =  1 . Hr  and  A^s.i  <  (■ 

for  I  =  Ur  -f  1 . n.  and  Aj5  ,  and  As,  .i  represent 

the  eigenvalue  of  JS  and  5i ,  respectivelv.  in 
descending  order.  Hence,  it  follows  that  for  any 
il'  >  0.  there  exists  A’  such  that  for  all  d  >  N 


A  iZ 


<  s. 


(li)  The  proof  is  dual  to  the  proof  of  (i).  □ 


Remark  2.1.  Theorem  2.1  provides  two  ways  of 
weigliting  matrices  selection  resulting  in  a  nearlv  non- 
rriinimal.  low  authority  LQG  compensator  for  a  stable 
p  ant.  The  first  approach  starts  by  transforming  the 
plant  .-1  into  coordinates  such  that  .-1  has  the  represen¬ 
tation  as  in  equation  (2.23a)  after  transformation.  Then 
select  the  weighting  matrix  Ri  with  the  partitioned  form 
a.s  in  (2. 2.1b)  and  with  rank  Ri  =  Ur.  By  decreasing  the 
authority  of  the  compensator,  or,  equivalently,  increas- 
i'^g  or  3.  the  eigenvalue  ratio,  of  the  LQG 

compensator  decreases  and  the  LQG  compensator  ap¬ 
proaches  nonminimality  with  minimal  dimension  of  nr. 

I  sing  a  dual  approach,  with  ,-4  and  V  j  partitioned  as  in 
(2.26).  by  increasing  ||f?2||  or  a,  the  resulting  LQG  com¬ 
pensator  approaches  nonminimality.  However,  in  the 
lirmting  case,  as  a  —  x.  or  d  —  x'then  it  follows  from 
(2.7)  and  (2.8)  that  P  —  0  and  Q  —  0.  respectivelv. 


Remark  2.2.  .Note  that  if  A  is  in  a  modal  form 
then  It  satisfies  both  (2.23a)  and  (2.26a)  of  Theorem 
2.1.  In  this  ca.se.  /?)  given  by  (2.23b).  describes  a  state 
weiguing  matri.x  in  which  only  the  states  pertainin'^ 
lo  selected  modes  are  weighted.  Similarly.  T,  given  by 
(2.26b)  describes  a  disturbance  that  excites  only  certain 

^  uncommon  for  these  conditions  to  be 

satisfied  or  nearly  satisfied  in  practice. 


Remark  2.3.  'The  continuou,s-time  results  stated 
111  Lemma  2,1.  2.2  and  Ilieorem  2.1  are  readily  extended 
to  their  discrete-time  counlerparts  as  shown  in  [8], 


3.  Numerical  Illustrative  Examples 

"^o  ill  list  rate  I  he  proper  choices  of  the  woighiing  nia- 
t rices  resulting  in  a  nearly  nonminimal.  low  authority 
bQG  compensator  for  a  stable  continuous-iirne  plant, 
consider  a  simply  supported  beam  with  two  collocated 
sensor/actuator  pairs.  .Assuming  the  beam  has  length  2 
and  that  the  sen.sor/actiiator  pairs  are  placed  at  coor- 
iliiiates  n  =  and  /y  =  ^.  a  continuous-time  model 
(2.1)  retaining  the  first  five  modes  is  obtained  with 


•A  =  block-diag( 


0  1 
-81  -.09 


■1 


I 

-.01 


B  = 


0 

-0.2174 

0 

0.4245 

0 

-0.6112 

0 

0.7686 

0 

-0.8893 


0  1 
-•256  -.16 

0  - 
1  -0.8439 
0 

-0.90-54 

0 

-0.1275 

0 

0.7686 

0 

0.9522  , 


0  1 
-16  -.04 

0  1 
-625  —.25 


C= 


The  noise  intensities  are  V,  =  DiDj  =  O.l/io  and  lo  = 

D-^D^  =  3h-  and  it  is  assumed  that  Tjo  =  DiDj  =  0. 
The  design  objective  is  to  minimize  the  continuous-time 
cost  J  —  lim(_,.^  -p  where  /?•>  =  o/o. 

Note  that  the  magnitude  of  the  positive  real  liumbers 
Q  and  ji  are  the  indicators  of  the  controller  author¬ 
ity  level.  For  this  particular  plant,  A  has  the  repre¬ 
sentation  as  in  (2.23a)  and  (2.26a)  with  =  0  and 
-*^21  —  0,  respectively.  Here,  we  illustrate  the  results 
of  property  (/)  of  Theorem  2.1  for  the  cases  of  rir  =  2 
and  nr  =  6.  Setting  q  =  0.1,  by  selecting  the  weighting 

matrix  R\  =  q"  q  •  increasing  ^  (hence,  tie- 

creasing  the  compensator  authority),  the  resulting  LQG 
compensator  approaches  nonminimality  with  rmnimal 


dimension  of  or.  equivalently. 


riQP) 


0  where 


A,  is  the  sorted  (in  descending  order)  eigenvalue  of 


QP.  Figure  1  shows  the  ratio  curve  for  nr  =  2  with 
^  €  (0.01.0.1,  1.  10,  lUl  10^.  10^  10^  10^).  The  curve 
dearly  indicates  that  tiie  ratio  decreases  as  3  increases. 
To  illustrate  that  suboptimal  controller  reduction  meth¬ 
ods  yield  nearly  optimal  reduced-order  compensators  for 
low  authority  control  problems.  Figure  1  also  shows 
the  norm  of  the  cost  gradient  of  the  2^‘^-order  con¬ 
troller  obtained  by  balancing.  I'he  cost  gradient  is  de- 
fined  as  [(vec  (vec  ^)T  (vec  The 

cost  gradient  curve  indicates  the  balanced  controller  ap¬ 
proaches  the  optimal  reduced-order  compensator  as  3 
increases,  or  as  the  control  authority  decrea.ses.  Figure 
2  shows  the  eigenvalue  ratio  of  the'LQG  controller  for 
Hr  -  6  and  the  norm  of  the  co.si  gradient  of  the  corre- 
sponding  6"'-or(ler  balanced  controller. 
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('oiU(?r5*.'ly.  if  the  weighting  term  R[  for  the  above 
example  does  not  have  the  structure  given  by  (2.23b). 
(Iccrea.sing  the  controller  autliority  (i.e..  increasing  J) 
may  not  yield  a  nearly  nonmimmal  LQ(t  compensator. 
A.s  an  ap [parent  consequence,  the  norm  ot  the  cost  gra¬ 
dient  of  th^  corresponding  2"^-order  balanced  controller 
does  not  a|)proach  zero  as  the  control  authority  de- 
rrease*>.  This  is  illustrated  in  Figure  3  for  Ur  =  2  and 
=  /i„.  N.>t.‘  that  for  this  particular  example,  at 

J  =  0.0 1  the  balanced  controller  destabilizes  the  closed- 
loop  .system  and  hence  the  norm  ot  the  cost  gradient 
becomes  infinite. 

4.  Conclusion 

Bv  exploiting  structural  properties  of  the  solutions 
of  the  Riccati  equations  and  Lyapunov  equations,  this 
paper  shows  that  for  continuous-time  stable  systems, 
if  the  coefficient  matrix  .4  and  driving  weighting  term 
(or  Vy)  have  specific  .structures,  the  corresponding 
LQG  compensator  becomes  nonminimal  as  the  control 
authority  is  decreased.  As  illustrated  by  the  example, 
this  near  nonmininiality  can  result  in  near  optimality 
of  a  controller  obtained  by  suboptimal  controller  reduc¬ 
tion.  Conversely,  the  example  shows  that  if  the  structure 
of  the  weighting  matrices  do  not  satisfy  the  conditions 
specified  in  Theorem  2.1.  the  resulting  LQCt  compen¬ 
sator  is  not  necessarily  nearly  minimal  even  at  low  con¬ 
trol  authority.  In  this  case,  reduced-order  controllers 
obtained  by  suboptimal  projection  methods  may  not  be 
nearly  optimal  even  at  low  authority. 
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Abstract 

Homotopy  approaches  have  previously  been  developed  for  synthesizing  H2  optimal  reduced- 
order  models.  Some  of  the  previous  homotopy  algorithms  were  based  on  directly  solving  the  optimal 
projection  equations,  a  set  of  two  Lyapunov  equations  mutually  coupled  by  a  nonlinear  term  involv¬ 
ing  a  projection  matrix  r,  that  characterize  the  optimal  reduced-order  model.  These  algorithms  are 
numerically  robust  but  suffer  from  the  curse  of  large  dimensionality.  Subsequently,  gradient-based 
homotopy  algorithms  were  developed.  To  make  these  algorithms  efficient  and  to  eliminate  singular¬ 
ities  along  the  homotopy  path,  the  basis  of  the  reduced-order  model  was  constrained  to  a  minimal 
parameterization.  However,  the  resultant  homotopy  algorithms  sometimes  experienced  numerical 
id-conditioning  or  failure  due  to  the  minimal  parameterization  constraint.  This  paper  presents  a 
new  homotopy  approach  to  solve  the  optimal  projection  equations  for  Ho  model  reduction.  The 
current  algorithm  avoids  the  large  dimensionality  of  the  previous  approaches  by  efficiently  solving 
a  pair  of  Lyapunov  equations  coupled  by  low  rank  linear  operators. 
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9109558  and  ECS-9350181,  the  National  Aeronautical  and  Aerospace  Administration  under  Con¬ 
tract  NAS8-38575,  and  the  Air  Force  Office  of  Scientific  Research  under  Contract  F49620-91-C-0019. 


1.  Introduction 


The  continued  and  pressing  need  for  more  accuracy  in  mathematical  modeling  of  physical  pro¬ 
cesses  has  led  to  increasingly  high-dimensional  models.  In  order  to  simplify  computer  simulations 
and  the  design  process  for  feedback  compensation,  many  model  reduction  schemes  have  been  pre¬ 
sented  during  the  last  two  decades.  Among  these  is  the  quadratically  optimal  (or  i/j  optimal) 
model  reduction  problem.  This  optimization  problem  involves  determining  a  reduced-order  model 
of  fixed  dimension  whose  outputs  approximate  the  outputs  of  the  original  model  in  a  least  squares 
sense.  The  associated  necessary  conditions  were  studied  bj^  Wilson  in  (1970, 1974).  Significant  sim¬ 
plification  of  Wilson’s  results  were  achieved  by  recognition  and  exploitation  of  an  obbque  projection 
matrix  by  Hyland  and  Bernstein  (1985).  The  resulting  necessary  conditions  of  optimabty  are  char¬ 
acterized  by  “optimal  projection  equations”  which  consist  of  a  pair  of  n  x  n  modified  Lyapunov 
equations  that  are  mutually  coupled  by  nonlinear  terms  involving  a  projection  matrix  r. 

The  optimal  H2  model  order  reduction  problem  is  essentially  a  “younger  brother”  of  the  more 
important  problem  of  optimal  H2  reduced-order  controller  design.  For  example,  the  optimal  pro¬ 
jection  equations  for  reduced-order  modelling  are  a  subset  of  the  optimal  projection  equations  for 
reduced-order  control  developed  by  Hyland  and  Bernstein  (1984).  Hence,  an  important  reason  for 
investigating  numerical  solutions  to  the  model  reduction  problem  is  to  provide  an  intermediate  step 
in  the  development  of  numerical  solutions  to  the  reduced-order  control  problem. 

Several  approaches  have  been  considered  to  synthesize  H2  optimal  reduced  order  models.  Based 
on  the  first-order  necessary  condition  of  optimabty,  Wblson  (1970,  1974)  and  Hirzinger  and  Kreis- 
selmeier  (1975)  presented  approaches  which  implemented  the  Fletcher- Powell  gradient  algorithm 
to  minimize  the  cost  over  the  reduced-order  model  parameters  for  a  multi-input,  multi-output 
(MIMO)  system.  Aplevich  (1973)  and  Mishra  and  Wilson  (1980)  proposed  similar  approaches 
based  on  the  steepest  descent  algorithm.  Using  the  pole-residue  form  of  the  transfer  function. 
Bryson  and  Carrier  (1990)  obtained  analytical  e,xpressions  for  the  first  and  second  order  derivatives 
of  the  cost  function  and  proposed  a  Newton-Raphson  algorithm  for  the  optimad  model  reduction 
of  a  single-input,  single-output  (SISO)  system.  By  reformulating  the  cost  function  for  a  SISO 
system  and  exploiting  its  relationship  with  the  coefficients  of  the  transfer  function.  Spanos  et  al. 
(1990)  developed  a  two-step  gradient-descent  algorithm  to  alternately  optimize  the  numerator  and 
denominator  coefficients  of  the  transfer  function  of  the  reduced-order  model  and  this  algorithm  was 
proved  to  be  globally  convergent. 
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Recently,  several  homotopy  algorithms  were  developed  for  the  H2  optimal  model  reduction 
problem.  There  are  at  least  three  reasons  for  considering  homotopy  or  continuation  methods  for 
optimization  problems  arising  in  engineering  applications.  First  of  all,  it  is  often  desired  to  find 
solutions  for  various  values  of  some  set  of  parameters  describing  the  problem.  These  parameters 
can  determine  the  description  of  the  nominal  plant,  the  input  authority  (in  control  problems),  the 
amount  of  system  uncertainty,  etc...  Homotopy  methods  can  be  much  more  efficient  in  generating 
these  sets  of  solutions  than  alternative  methods  due  to  the  use  of  prediction  steps.  (To  highlight 
the  importance  of  the  predicition  step,  various  prediction  options  are  illustrated  for  the  homotopy 
algorithm  of  this  paper  via  an  example.)  Secondly,  if  formulated  properly,  each  intermediate  point 
along  a  homotopy  path  has  some  physical  meaning  which  is  useful  if  the  optimization  procedure 
is  forced  to  stop  before  final  convergence.  Thirdly,  a  homotopy  path  is  not  a  descent  path,  hence 
differentiating  homotopy  methods  from  most  alternative  techniques.  For  nonconvex  problems  the 
quickest  path  to  a  solution  may  not  be  a  descent  path  and  hence  a  homotopy  method  may  actually 
have  faster  convergence. 

The  first  homotopy  algorithms  for  optimal  model  order  reduction  were  based  on  directly 
solving  the  corresponding  optimal  projection  equations  (Zigic  ei  aL  1992,1993a).  These  algorithms 
are  numerically  robust.  However,  they  suffer  from  the  curse  of  large  dimensionality;  that  is,  the 
corresponding  homotopy  parameter  vector  is  very  large  if  the  original  model  is  large.  Hence,  these 
algorithms  are  intractable  for  large  scale  problems. 

The  above  deficiencies  led  to  the  development  of  homotopy  algorithms  directly  ba.sed  on  the 
gradient  expressions  (Ge  et  ai  1993a,  1993b).  In  these  schemes,  the  parameter  vector  p  represents 
the  reduced-order  model.  In  order  to  keep  the  dimension  of  p  relatively  small  and  to  avoid  high  order 
singularities  along  the  homotopy  path,  minimal-order  parameterizations  of  the  reduced-order  model 
were  considered.  Because  of  the  reduction  in  the  number  of  parameters,  the  ];esulting  algorithms 
are  often  more  efficient  than  the  original  algorithms  based  on  the  optimal  projection  equations. 
However,  since  the  assumed  parameterization  may  fail  to  exist  or  lead  to  ill-conditioning  related  to 
the  insistence  on  using  the  minimal  number  of  parameters,  these  resulting  algorithms  sometimes  fail 
or  have  very  poor  convergence  properties.  One  alternative  approach  proposed  by  Ge  et  ai  (1993b) 
is  to  develop  an  algorithm  that  utilizes  several  minimal  parameter  homotopies  and  is  capable  of 
switching  to  an  alternative  parameterization  if  ill-conditioning  is  encountered  with  the  current 
parameterization.  A  second  approach  is  to  develop  an  algorithm  based  on  the  optimal  projection 
equations  that  efficiently  exploits  some  of  the  inherent  structure  in  the  matrix  design  equations  and 
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hence  reduces  the  effective  size  of  the  homotopy  parameter  vector  in  the  spirit  of  the  homotopy 
algorithm  described  in  Collins  et  al.  (1993). 

This  second  approach  is  pursued  in  this  paper.  In  particular,  in  order  to  compute  the  homo¬ 
topy  curve  tangent  vectors  and  the  correction  steps,  the  algorithm  described  here  avoids  explicit 
computation  and  inversion  of  the  Jacobian  of  the  homotopy  map  eis  in  the  homotopy  dgorithms 
of  Zigic  et  al.  (1992,1993a).  (It  should  be  acknowledged  that  Zigic  ei  al.  (1992,1993a)  does  not 
exactly  invert  the  Jacobian  of  the  homotopy  map,  but  it  does  perform  an  operation  that  ha.s  an 
equivalent  computational  burden.)  Instead,  the  algorithm  developed  here  computes  the  tangent 
vectors  and  corrections  by  solving  two  Lyapunov  equations  mutually  coupled  by  linear  operators. 
These  equations  are  efficiently  solved  using  the  results  of  Richter  et  al.  (1993)  which  exploits  the  low 
rank  properties  of  the  coupling  terms.  The  resultant  computational  savings  over  the  computational 
requirements  of  the  algorithms  of  Zigic  et  al.  (1992,1993a)  are  roughly  equivalent  to  those  obtained 
by  computing  a  solution  to  a  Lyapunov  equation  via  a  matrix  method  (e.g.,  Brewer  (1978)  and 
Lanccister  and  Tismenetsky  (1985))  versus  computing  a  Lyapunov  equation  solution  via  solving 
the  associated  linear  matrix  equation  Ax  =  h  where  x  is  a  vector  representing  the  independent 
elements  of  the  solution  to  the  Lyapunov  equation. 

It  should  be  mentioned  that  the  homotopy  algorithms  of  Zigic  et  al.  (1992,1993a)  are  based  on 
arc  length  and  hence  allow  for  singular  Jacobians.  Hence,  they  do  not  assume  that  the  homotopy 
curve  is  monotonic  w’ith  respect  to  the  homotopy  parameter.  The  algorithm  here  does  assume 
monotonicity.  It  appears  to  be  possible  to  extend  the  algorithm  to  relax  this  assumption  by  using 
a  technique  related  to  that  developed  by  Zigic  et  al.  (1993b).  However,  this  is  a  subject  of  future 
research. 

The  focus  of  this  paper  is  on  computational  efficiency.  Rigorously  proving  the  existence  of  the 
homotopy  path  that  we  formulate  is  beyond  the  scope  of  the  current  paper  but  is  currently  being 
considered  in  research  being  performed  at  the  Virginia  Polytechnic  Institute  and  State  University 
by  Prof.  Layne  Watson  and  his  students.  However,  in  our  computational  experience,  the  homotopy 
path  has  always  existed. 

The  paper  is  organized  as  follows.  Section  2  presents  the  optimal  projection  equations  for  the 
H2  model  reduction  problem.  Section  3  gives  a  brief  synopsis  of  homotopy  methods.  Kext,  Section 
4  develops  a  new  homotopy  algorithm  for  optimal  model  reduction  design  based  on  the  optimal 
projection  equations.  Section  5  illustrates  the  algorithm  with  three  illustrative  examples.  Finally, 
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Section  6  presents  the  conclusions. 


Nomenclature 


IE 

X  n 

Y>X 
Y  >  X 

Xij  or  Xij 

Xt 

X* 

Ir 

tr  X 

II^IIf,  II^IIa 

vec(-) 


.(i 

m 


X(:,A') 

onx  n 


x?s 


nxn 


expected  value 

n  X  1  real  vectors,  m  x  n  real  matrices 
y  -  X  is  nonnegative  definite 

Y  —  X  is  positive  definite 
(i,  j)  element  of  matrix  X 

Moore-Penrose  generalized  inverse  of  matrix  X  (Rao  and  Mitra  1971) 
Group  inverse  of  matrix  X  (Rao  and  Mitra  1971) 
r  X  r  identity  matrix 
trace  of  square  matrix  X 

Frobenius  norm  (||X||p  =  tr  XX'^),  absolute  norm  (||A"11a  =  m2LX,j|A\j|) 

the  invertible  linear  operator  defined  such  that 

vec(5)  =  [5J  sj  •  5  € 

where  sj  €  denotes  the  column  of  5. 

the  m-dimensional  column  vector  whose  i^^  element 
equals  one  and  whose  additional  elements  are  zeros. 

r* 

column  of  the  matrix  X  (MATLAB  notation) 
the  space  of  symmetric  matrices  in 

gnxn  ^  gnxn 


2.  The  Optimal  Projection  Equations  for  Model  Reduction 
Consider  the  n‘^-order.  stable,  linear  time-invariant  plant 


x{t)  =  Ai(t)  +  Bw(t), 


(2.1a) 
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y{t)  =  Cx{t), 


(2.16) 


where  {A,B,C)  is  controllable  and  observable,  x{t)  €  R^,w{t)  €  R"*  is  a  white  noise  process  with 
positive- definite  intensity  V,  and  y{t)  €  R'.  For  a  given  Um  <  n,  the  goal  of  the  optimal  fixed- order 
model-reduction  problem  is  to  determine  an  n{^-order  model 

Xm{t)  =  A^Xmii)  +  Bmw{tfi  (2.2a) 

yAt)  =  (2-26) 

where  ^^(t)  G  R”"* ,  j/m(0  ^  which  minimizes  the  steady-state  quadratic  model  error  criterion 

}sm  m[{y-ymVE'^E{y-yrr.)],  (2.3) 

1—4.00 

where  E  is  an  error  weighting  matrix  and  R  =  E'^ E  is  positive  definite.  To  guarantee  that  J  is 
finite,  it  is  assumed  that  A  is  asymptotically  stable  and  since  the  value  J  is  independent  of  the 
internal  realizations  of  the  reduced-order  models,  we  restrict  our  attention  to  the  set  of  reduced- 
order  models,  5+  =  {{Am,Bm,Cm)  •  A^  is  asymptotically  stable,  {Am,Bm)  is  controllable  and 
(Am, Cm)  is  observable}. 


Next,  forming  the  augmented  system  consisting  of  (2.1)  and  (2.2), 

x{i)  =  Ax{t)  +  Bw{t), 


y(t)  =  Cx{t), 


where 


.4^ 


i(t)  = 


A  0 
0  Am 


x(t) 

Xm  (0 


,  3/(0  =  3/(0  -  3/m(0. 


B 


B 

Bm 


,  C  =  [C  -  Cm], 


allows  the  cost  (2.3)  to  be  expressed  as 


(2.4a) 

(2.46) 


JiAm.Bm.Cm)  =  Um  IE[i'^(0^i(0]^ 

where  R  =  RC.  Next,  introduce  the  weighted  performance  variables 

z{i)  =  E{y{i)  -  ym(t))  =  Ex{t), 


(2..3a) 


where  E  =  [EC  —  EC-m]-  Also  define  the  transfer  function  from  w  to  z  by 


H{s)  =  E{sh-Ar^B, 
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where  n  =  n  + 


Then,  it  follows  that  if  the  augmented  system  A  is  asymptotically  stable,  (2.5a)  is  given  by 

JiAm,Brr,,Cm)  =  \\H{s)\\l  =  -^  J^J\H {ju)\\ldu  =  tv  Q R  =  tv  PV ,  (2.56) 

where  Q  =  steady-state  augmented  system  covariance,  P  is  its  dual, 

and  V  =  BVB'^  .  Furthermore,  Q  and  P  satisfy  the  respective  Lyapunov  equations 


0  =  iO  +  +  V, 

(2.6a) 

0  =  A^P  +  PA  +  R. 

(2.66) 

Before  presenting  the  main  theorem  we  present  a  key  lemma  concerning  nonnegative  definite 
matrices  and  several  definitions. 

Lemma  2.1.  (Bernstein  and  Haddad,  1990).  Suppose  Q  €  and  P  6  are 

symmetric  and  nonnegative-definite  and  rank  QP  —  Then,  the  following  statements  hold: 

{i)  The  n  X  n  matrix 

T^QPiQpf,  (2.7) 

is  idempotent,  i.e.,  r  is  an  oblique  projection  and  rank  r  =  71^- 
(ii)  There  exist  G.P  £  and  nonsingular  M  £  such  that 


QP  =  G'^MP, 

(2.8) 

PG'^  =  . 

- 

(2.9) 

{Hi)  Finally,  if  rank  Q  =  rank  P  =  rank  QP  =  n„,,  there  exists  a  nonsingular  transformation 
e  such  that 

0' 


Q  =  W 
P  =  w-'^ 


0  0 

n  0 
0  0 


(2.10a) 

(2.106) 


where  £  R”'"’'’^'"  is  diagonal  and  nonsingular. 
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Definition  2.1.  A  triple  {G,M,r)  satisfying  property  (n)  of  Lemma  2.1  is  a  projective  fac¬ 
torization  of  QP. 

Definition  2.2.  A  model  {Am,Bm,Cm)  is  an  extremal  of  the  optimal  fixed-order  model- 
reduction  problem  if  it  satisfies  the  first  order  necessary  conditions  of  optimality,  i.e., 

dJ  ^  dJ  ^  dJ  ^ 

uAm  dBrn  ^Cm 

where  J{Am,  Bm,Cm)  is  defined  by  (2.3). 

Definition  2.3.  A  model  {Am,Bm,Cm)  is  an  admissible  extremal  of  the  optimal  fixed-order 
model-reduction  problem  if  it  is  an  extremal  and  is  also  in  S^,  i.e.,  the  reduced-order  model  is 
asymptotically  stable,  controllable  and  observable. 


Finally,  define  the  positive-definite  controllability  and  observability  Gramians 


Wc=  r  e^^BVB'^e^'^^dt, 

Jo 

(2.11) 

Wo=  1  RCe^^di, 

Jo 

(2.12) 

which  satisfy  the  dual  Lyapunov  equations 

0  =  AWc  -b  WcA'^  -f  BVB'^, 

(2.13) 

0  =  A'^Wo  -b  W^A  +  C'^RC. 

(2.14) 

Theorem  2.1.  (Hyland  and  Bernstein,  1985).  Suppose  {Am^  Bm^Cm)  is  an  admissible 

extremal  of  the  Ho  optimal  model-reduction  problem.  Then  there  exist  n  x  n  nonnegative-definite 

matrices  (J.P  such  that,  for  some  projective  factorization  (G.M.T)  of  QP.  Am^B^  a^nd  Cm  a^re 

given  by 

Am  -  P AG^ ,  Bm-PB,  Cm  —  CG^^  (2.15a, 6,  c) 

and  such  that  Q,  P  satisfy 

Q  =  AQ  +  QA^  ABVB'^ -t^BVB'^tI, 

Q  =  A'^P  +  PA  +  C'^RC -tIc'^RCt^, 

(2.16) 

(2.17) 

rank  Q  =  rank  P  =  rank  Qp  =  n^, 

(2.18) 

I 


where  r  is  given  by  (2.7)  and  ~  r.  Furthermore,  the  minimal  cost  is  given  by 


J{Am.B^,C^)  =  tr  [C'^RCiW,  -Q]  =  Xt  {BVB'^{Wo  -  P)].  (2.19) 

Conversely,  if  there  exist  n  x  n  nonnegative-definite  matrices  Q  and  P  satisfying  (2.16)-(2.18) 
then  the  reduced-order  model  {AmiBmiCm)  given  by  (2.15)  is  an  extremal  of  the  optimal  fixed- 
order  model  reduction  problem.  Furthermore,  Am  is  asymptotically  stable  if  and  only  if  {A,E)  is 
detectable.  In  this  case,  {Am,Bm)  is  controllable  and  {AmiCm)  is  observable. 

Remark  2.1.  Partitioning  Q  and  P  given  by  (2.6a)  and  (2.6b),  respectively,  as 

Q=\nT  €  R”"^”’",  (2.20) 

L  Vi2  V2  J 

p=  dT  ,Pi  €  R"’'",F2  e  R”-"^"”*,  (2.21) 

.^12  ^2  J 

it  follows  from  Hyland  and  Bernstein  (1985)  that  Q  and  P  given  by  (2.16)  and  (2.17)  can  be 
expressed  as 

Q  =  Qi7Q2"QJ2,  (2.22) 

and 

P  =  P12P 2  P\2^  (2.23) 

respectively. 

Theorem  2.1  shows  that  one  can  compute  an  optimal  reduced>order  model  by  solving  a  set  of 
coupled,  modified  Lyapunov  equations  (2.16)  and  (2.17)  subject  to  the  rank  condition  constraints 
(2.18).  One  approach  to  find  a  solution  of  (2.16)  and  (2.17)  is  based  on  homotopy  methods. 

3.  Homotopy  Methods  for  the  Solution  of  Nonlinear  Algebraic  Equations 

A  “homotopy’’  is  a  continuous  deformation  of  one  function  into  another.  Over  the  past  several 
years,  homotopy  or  continuation  methods  (whose  mathematical  basis  is  algebraic  topology  and 
differential  topology  (Lloyd  1978))  have  received  significant  attention  in  the  mathematics  litera¬ 
ture  and  have  been  appbed  successfully  to  several  important  problems  (Avila  1974.  Wacker  1978, 
Alexander  and  Yorke  1978,  Garcia  and  Zangwill  1981,  Eaves,  ei  al.  1983,  Watson,  1986).  Recently, 
the  engineering  literature  has  also  begun  to  recognize  the  utility  of  these  methods  for  engineering 
applications  (see  e.g.,  Richter  and  DeCarlo  1983,  1984,  Turner  and  Chun  1984,  Dunyak  et  al.  1984, 
Lefebvre  et  al.  1985,  Sebok  et  al.  1986,  Horta  et  al.  1986,  Kabamba  et  al.  1987.  Shin  et  al. 


1988,  Rakowska  et  al.  1991).  The  purpose  of  this  section  is  to  provide  a  very  brief  description  of 
homotopy  methods  for  finding  the  solutions  of  nonlinear  algebraic  equations.  The  reader  is  referred 
to  Watson  (1986,  1987),  and  Richter  and  DeCarlo  (1983)  for  additionzd  details. 

The  basic  problem  is  as  follows.  Given  sets  U  and  V  contained  in  R"  and  a  mapping  F:U  -♦V, 
find  solutions  u  £  U  to  satisfy 

F{u)  =  0.  (3.1) 

Homotopy  methods  embed  the  problem  (3.1)  in  a  larger  problem.  In  particular  let  H:U  x  [0, 1] 

R"  be  such  that: 

1)  H{u,l)=F{u). 

2)  There  exists  at  least  one  known  uq  €  R"  which  is  a  solution  to  =  0,  i.e., 

H{uo,0)  =  0.  (3.2) 

3)  There  exists  a  continuous  curve  (u(A),  A)  in  R"  x  [0, 1]  such  that 

/f(u(A),  A)  =  0  for  A  €  [0, 1],  (3.3) 

with 

(n(0),0)  =  (uo,0).  (3.4) 


4)  The  curve  (u(A),  A)  is  differentiable. 

A  homotopy  algorithm  then  constructs  a  procedure  to  compute  the  actual  curve  such  that  the 
initial  solution  ti(0)  is  transformed  to  a  desired  solution  u{\)  satisfying 

0  =  i/(u(l).l)=  f(u(l)).  (3..5) 


Now,  differentiating  H{u{X).  \)  =  0  with  respect  to  A  yields  Davidenko’s  differential  equation 


dH  du  dH  „ 
du  dX  dX  ’ 


(3.6) 


which  together  with  ti(0)  =  uq,  defines  an  initial  value  problem.  The  desired  solution  ti(l)  is  then 
obtained  by  numerical  integration  from  0  to  1.  Some  numerical  integration  schemes  are  described 
in  W'atson  (1986,  1987). 
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4.  A  Homotopy  Algorithm  for  H2  Optimal  Reduced-Order  Modeling 

This  section  first  introduces  a  homotopy  map  ba^ed  on  the  optimal  projection  equations  and 
then  presents  the  linearly  coupled  Lyapunov  equations  that  must  be  solved  for  the  prediction 
and  correction  steps.  Next,  the  homotopy  algorithm  for  the  optimal  model  reduction  problem  is 
presented.  FinaUy,  the  initialization  of  the  homotopy  algorithm  is  discussed  in  detail. 

4.1.  The  Homotopy  Map 

To  define  the  homotopy  map  we  cissume  that  the  plant  matrices  {A,  B,C),  the  error  weighting 
matrix  R  and  the  disturbance  intensity  matrix  V  are  functions  of  the  homotopy  parameter  A  €  [0, 1]. 
In  particular,  it  is  assumed  that 

r4(A)  B{X) 

_C(A)  0 

i2(A)  =  R(j  -f  X[Rj  —  Ro),  (^•2) 

F(A)  =  Vo  H- A(V>  -  Fo).  (4.3) 

Note  that  the  above  equations  imply  that  A(0)  =  Aq,  .B(O)  =  Bq,  ...,  V(0)  =  Fq;  and  that 
A(l)  =  A/,  B(l)  =  Bj,  ...,  V(l)  =  Vf.  For  notationaJ  simplification,  we  also  define 

S(A)  =  R(A)F(A)5T(A),  S(A)  =  C'^(A)i?(A)C(A).  (4.4a,  b) 

The  homotopy  formulation  0  =  A)  is  thus  given  by 

0  =  A(A)0(A)  +  (3(A)A(A)'^  +  -r(A)F(A)  -F  S(A)r'^(A)  -  T(A)S(A)r'r(A),  (4.5) 

0  =  A(A)^Q(A)  +  Q(A)A(A)  +  rT(A)S(A)  +  !:(A)r(A)  -  T'^(A)E(A)r(A),  .  (4.6) 

where 

rankQ(A)=  rankP(A)=  rank  (5(A)P(Aj  =  (4.7) 

r(A)  =  Q(A)P(A)[g(A)P(A)]#,  -(4.8) 

and  A  €  [0.  Ij. 

4.2.  The  Derivative  and  Correction  Equations 

The  homotopy  algorithm  presented  later  in  this  section  uses  a  predictor /corrector  numerical 
integration  scheme.  The  prediction  step  requires  derivatives  ((5(A),  P(A)),  where  M  =  while 


Ao  Bo 

Co  0 


+  '^( 


Af  Bj 
Cf  0 


Ao  Bo 

Co  0 


), 


(4.1) 
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the  correction  step  is  based  on  using  a  Newton  correction,  denoted  as  (AQ,AP).  Before  con¬ 
structing  the  derivative  and  correction  equations,  we  state  the  following  useful  properties  about  the 
contragredient  transformation  of  (Q,P). 


Using  Lemma  2.1,  equations  (4.7)  and  (4.8)  imply  that 


and 


where 


Q{X)  =  VU(A)A(A)VU'^(A)  =  Wa(A)n(A)Mf  (A), 

(4.9) 

P(A)  =  f/^(A)A(A)f/(A)  =  [/i(A)n(A)t/i^(A), 

(4.10) 

r(A)  =  WiX)  [  Y  {/(A)  =  W\{X)Uj{X), 

(4.11) 

iy(A)  =  [VUi(A)  LU2(A)],  H^i(A)  €  W2(A)  € 


UW  = 


t/T(A) 

UJ{X) 


or,  equivalently. 


,  f/i(A)6  172(A)  € 

UiX)  =  W-^iX), 

C/(A)iy(A)  =  /„, 


A(A)^ 


n(A)  0 
0  0 


,  n(A)eR 


Tim  ^  Tim 


(4.12a) 

(4.126) 

(4.13) 


and  fl(A)  is  diagonal  and  positive  definite.  For  notationaJ  simplicity,  we  omit  the  argument  A  in 
what  follows. 


The  derivative  equations,  obtained  by  differentiating  (4.5)  and  (4.6)  with  respect  to  A,  are  given 
by 

o  =  AuO  +  dAi  +  RQ{0.h  +  Rl(0-h  +  yQ  +  y^,  '  (4.14) 

and 

0  =  AiP  +  pa^,  -h  ijp(4  p)  +  Rpi^^h  +  +  yp-  (4.15) 

The  correction  equations,  derived  similarly  by  using  the  relationship  between  Newton’s  method 
and  a  particular  error  homotopy,  are  given  by 

0  =  A^AQ  +  AQAl  +  R^q(AQ,  aP)  +  RlgiAQ,  Ap)  +  (4.16) 

and 

0  =  aIaP  +  aPa^  +  R^piAQ,  aP)  +  Rlp{AQ,  AP)  +  Ep.  (4.17) 
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The  detail  derivation  of  (4.14)-(4.17)  and  the  definitions  of  all  the  coefficients  are  described  in 
Appendix  A.  Comparing  (4.16)-(4.17)  with  (4.14)-(4.15)  reveals  that  the  derivative  and  correction 
equations  are  identical  in  form.  Each  set  of  equations  consist  of  two  coupled  Lyapunov  equations. 
Since  these  equations  are  linear,  using  Kronecker  algebra  (Brewer  1978)  and  exploiting  the  rank 
condition  (2.18)  of  Q  and  F,  they  can  be  converted  to  the  vector  form  Ax  =  b  where  for  (4.14)- 
(4.15)  X  3-  vector  consisting  of  the  independent  elements  of  and  fl.  Hence,  >1  is  a  {2nnm  + 

n^)  X  (2nnm  +  n^)  matrix  and  must  be  inverted  to  compute  x-  Thus,  inversion  is  hence  very 
computationally  intensive  for  even  relatively  small  problems  (e.g.,  n  =  10,  n„,  =  6). 

Fortunately,  the  coupling  terms  and  Rp  which  are  linear  functions  of  (ITi,  or,  equiv¬ 

alently,  iQ,P)  in  (4.14)  and  (4.15),  respectively,  have  relatively  low  ranks.  Hence,  the  technique  of 
Richter  et  al.  (1993),  which  exploits  this  low  rank  property,  can  be  used  to  efficiently  solve  equa¬ 
tions  (4.14)  and  (4.15)  (or,  equivalently,  (4.16)  and  (4.17)).  In  particular,  this  solution  procedure 
which  is  detailed  in  Appendix  B,  requires  an  inversion  of  a  square  matrix  of  dimension  Umi'm  -f  /), 
which  is  identical  to  the  dimension  of  the  homotopy  Jacobian  inverted  in  the  minimal  parameteri¬ 
zation  approach  (Ge  et  al.  1993a,1993b).  Hence,  the  computational  efforts  required  by  the  present 
approach  are  comparable  to  that  required  by  a  minimal  parameter  homotopy. 

Also,  note  that  if  the  homotopy  path  exists,  the  solution  to  the  coupled  Lyapunov  equations 
will  be  weD-posed.  Hence,  the  matrices  A,,  and  A.uj  in  (4.14)-(4.17)  will  have  the  property  that  any 
two  eigenvalues  of  a  given  matrix  will  not  sum  to  zero. 


4.3.  Overview  of  the  Homotopy  Algorithm 

Below,  we  present  an  outline  of  the  homotopy  algorithm.  This  algorithm  describes  a  predic¬ 
tor/corrector  numerical  integration  scheme.  In  order  to  force  the  rank  conditions  (2.18)  of  Q  and 
P  during  intermediate  steps,  we  use  the  following  scheme  to  update  {Q,P)  along  the  homotopy 
path.  First,  using  ( A.15)‘(A.17)  and  (A.29)-(A.31)  and  the  dgorithms  described  in  Appendix  C, 
the  prediction  (Q.P)  and  correction  (AQ,  AP)  are  converted  to  {Wi.Ui.il)  and  (AK^i,  Ai7i,  Af2), 
respectively.  Note  that  Q  and  Afi  are  forced  to  be  Um  x  Um  diagonal  matrices  with  this  formu¬ 
lation.  Next,  we  update  {Wi^Ui.Cl)  with  these  predictions/corrections.  Finally,  new  (Q.P)  are 
constructed  with  updated  using  (4.9)  and  (4.10)  and  the  rank  conditions  (4.7)  are 

maintained. 

There  are  several  options  to  be  chosen  initially.  These  options  are  enumerated  before  presenting 
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the  actual  algorithm.  Note  that  each  option  corresponds  to  a  particular  flag  being  assigned  some 
integer  value. 

4.3.1,  Prediction  Scheme  Options 

Here  we  use  the  notation  Aq,  A_i,  and  Ai  representing  the  values  of  A  at  respectively  the  current 
point  on  the  homotopy  curve,  the  previous  point,  and  the  next  point.  Also,  M  =  dM jdX  and  ^(A) 
is  a  vector  representation  of  (lyi(A),  [/i(A),  fi(A)). 

pred  =  0.  No  prediction.  This  option  assumes  that  0{Xi)  =  ^(Ao). 

pred  =  1.  Linear  prediction.  This  option  assumes  that  0{Xi)  is  predicted  using  0(Ao)  and 
0(Ao),  i.e.,  0(Ai)  =  ^(Ao)  +  (Ai  —  Ao)^(Ao). 

pred  “  2.  Cubic  spline  prediction. 

This  prediction  of  0(Ai)  requires  ^(Aq),  0(Ao), ^(A_i ),  and  6(A^i).  In  particular, 

vec[0(Ai)]  =  ao  +  uiAi  +  uoA^  +  U3A1, 


where  ao,ai,a2,  and  03  are  computed  by  solving 


-  1 

0 

1 

0  ■ 

■vec(^(A_i)]- 

A_i 

1 

Ao 

1 

vec[0(A_i)] 

Ail 

2A_i 

Ag 

2Ao 

vec[e(Ao)] 

LAii 

3Aij 

A^ 

3Agj 

.  vec[0(Ao)]  . 

Note  that  if  0(A_i)  and  0(A^i)  are  not  available  (as  occurs  at  the  initial  iteration  of  the  homotopy 
algorithm),  then  0(Ai)  is  predicted  using  linear  prediction,  i.e., 


0(Ai )  =  0(Ao)  +  { A)  —  Ao)^(Ao). 


4.3.2.  Basis  Options  for  Solving  the  Coupled  Lyapunov  Equations 

The  main  computational  burden  of  the  algorithm  given  below  is  the  solution  of  the  coupled 
Lyapunov  equations  (4.14)  and  (4.15)  or,  (4.16)  and  (4.17)  at  each  prediction  step  or  correction 
iteration.  Efficient  solutions  of  these  equations,  as  described  in  Appendix  B,  makes  the  algorithm 
feasible  for  large  scale  systems.  The  most  desired  solution  procedure  is  based  on  diagonalizing 
the  coefficient  matrices  and  of  the  coupled  Lyapunov  equations.  This  is  usually  possible. 
However,  it  is  also  possible  that  this  diagonalization  wiU  be  intractable  for  some  points  along  the 
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homotopy  path.  A  numerical  conditioning  test  is  embedded  in  the  program  to  determine  whether 
the  coefficient  matrices  are  truly  diagonalizable.  If  they  are  not,  then  the  coupled  Lyapunov 
equations  are  solved  using  the  Schur  decomposition.  A  second  option  relies  exclusively  on  the 
Schur  decomposition. 

basis  =  1.  A„  and  A^,  are  diagonalized  when  solving  (4.14)-(4.15)  or  (4.16)-(4.17). 
basis  =  2.  Au  and  Au.  are  in  Schur  form  when  solving  (4.14)-(4.15)  or  (4.16)-{4.17). 

4.3.3.  Outline  of  the  Homotopy  Algorithm 

Step  1.  Initialize  loop  =  0,  A  =  0,  AA  €  (0,1],  S  =  So,  {Q,P)  =  {Qo,Po)- 
Step  2.  Let  loop  =  loop  +  1.  If  loop  =  1,  then  go  to  Step  4. 

Step  3.  Advance  the  homotopy  parameter  A  and  predict  the  corresponding  Q(A)  and  P(A)  as 
follows. 

ScL.  LgI  Aq  —  A. 

3b.  L6t  A  —  Aq  “b  ZiA. 

3c.  If  pred  >  1,  then  perform  the  next  step  to  compute  Q(Ao)  and  P(Ao)  according  to  (4.14) 
and  (4.15).  Else,  let  (5(A)  =  (5(Ao)  and  F(A)  =  P(Ao)  and  go  to  step  (4),  i.e.,  no  prediction 
is  performed. 

3d.  Transform  A^  and  A^  into  suitable  matrix  form  by  using  the  option  defined  by  basis,  then 
solve  (4.14)  and  (4.15)  as  described  in  Appendix  B. 

3e.  Compute  (M'i(Ao).  Ui{Xo)JK>>o))  from  (Q(Ao),P(Ao))  by  using  ( A.15)-(A.17)  and  the  pro¬ 
cedure  described  in  .Appendix  C. 

3f.  Predict  (M^(A),  L'i(A),  fi(A))  by  using  the  option  defined  by  pred. 

3g.  Compute  (Q(A),  P(A))  from  (M'i(A),  Pi(A),  fI(A))  using  (4.9)  and  (4.10). 

Step  4.  Correct  the  current  approximations  Q(A')  and  P(A')  as  follows. 

4a.  Compute  the  errors  (E^.Ep)  in  the  correction  equations  (.\.24)-(A.25). 

4b.  Transform  A^  and  A^,  into  suitable  matrix  form  by  using  the  option  defined  by  basis,  then 
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solve  (4.16)  and  (4.17)  as  described  in  the  Appendix  B  for  AQ  and  AP. 

4c.  Compute  {AWi,AUi,AQ),  from  {AQ,Ap)  by  using  (A.29)-(A.31)  and  the  algorithms 
described  in  Appendix  C. 

4d.  Let  IVi(A)  ^  Vyi(A)  + AVFi,  17i(A)  ^  [/i(A)  +  AC/j,  n(A)  < — fl(A)  +  Afl. 

4e.  Compute  (<3(A),P(A))  from  (H'’i(A),  f/i(A),  fl(A))  using  (4.9)  and  (4.10). 

4f.  Recompute  the  errors  {E^,Ep)  in  the  correction  equations  (A.24)-(.\.25).  If  the 

preassigned  correction  tolerance,  then 
set  Aq  =  A,  and  adjust  next  step  size  A  A  according  to  the  number  of  the  correction  steps 
required  to  converge  before  going  to  Step  3b.  Else,  if  the  number  of  corrections  exceeds  a 
preset  limit,  reduce  AA  and  go  to  Step  3b;  otherwise,  go  to  Step  4b. 

Step  5.  If  A  =  1,  then  stop.  Else,  go  to  Step  2. 

Note  that  the  algorithm  described  above  allows  the  step  size  (AA)  to  vary  dynamically  de¬ 
pending  on  the  speed  of  convergence  which  is  gauged  by  the  number  of  the  correction  steps.  If 
the  number  is  small  (e.g.,  <  3),  we  increase  (e.g.,  double)  the  previous  step  size  when  computing 
the  next  step.  If  it  takes  many  steps  to  converge  (e.g.,  >  10),  or  does  not  converge,  the  step  size 
is  reduced  (e.g.,  in  half).  6"  in  Step  4f  is  a  preassigned  correction  error  tolerance  which  can  be 
assigned  with  two  values  in  the  program.  One  is  the  intermediate  correction  error  tolerance  which 
is  used  w'hen  A  <  1.  The  other  value  is  the  final  correction  error  tolerance  which  is  usually  smaller 
and  is  used  when  A  =  1.  The  choice  of  the  magnitudes  of  theses  tolerances  are  problem  dependent. 
In  general,  the  intermediate  correction  tolerance  is  desired  to  be  reasonably  large  to  speed  the 
homotopy  curve  following.  However,  the  algorithm  may  fail  to  converge  if  these  tolercinces  are  too 
large.  The  final  correction  tolerance  is  usuaUv  small  to  ensure  the  accuracv  of  the  final  results. 

4.4.  Initial  System  Selection 

In  this  subsection,  we  discuss  the  importance  of  the  homotopy  initialization  and  some  guidelines 
for  choosing  the  initial,  system  matrices.  It  is  assumed  that  the  designer  has  supplied  a  set  of 
system  and  weighting  matrices,  5/  =  {Af.Bj.Cj.Rf.Vj)  describing  the  optimization  problem 
whose  solution  is  desired.  In  addition,  it  is  assumed  that  the  designer  has  chosen  an  initial  set 
of  related  system  matrices  So  =  (Aq.Bo^Co^Ro^'^o)  that  has  an  easily  obtained  {Qo^Po)  '^’hich 
is  either  a  solution  or  a  good  approximation  to  the  solution  of  the  optimal  projection  equations 


15 


corresponding  to  the  initial  system  (i.e.,  (4.5)-(4.8)  with  A  —  0). 

While  in  general  homotopy  methods  ease  the  restriction  that  the  starting  point  be  close  to  some 
optimal  of  the  optimization  problem,  the  initial  guess  does  affect  the  performance  of  the  homotopy 
algorithm.  An  algorithm  with  an  initial  estimate  close  to  the  optimal  solution  usually  converges 
fast.  Furthermore,  different  initial  systems  may  lead  to  different  results.  However,  as  illustrated 
by  Example  5.1  below,  an  initial  system  with  lower  cost  than  an  alternative  initial  system  will  not 
alwavs  lead  to  an  optimal  reduced-order  model  with  lower  cost.  Below  we  describe  an  initialization 
approach  utilizing  component  cost  analysis  in  balanced  coordinates  (Kabamba  1985,  Skelton  and 
Kabamba  1986),  to  select  the  initial  system  matrices  So-  A  similar  approach  is  presented  in  Ge  et 
ai  (1993a,  1993b). 

4.4.1.  Initialization  Algorithm 

(i)  Perform  a  balanced  transformation  (Moore  1981)  on  the  given  system:  Xb  =  TbX  such  that 
the  controllability  and  observability  Gramians  in  the  balanced  coordinates  are  given  by 
Wc,b  =  Wo,b  =  diag  ((7i,cr2,...,o-„),  and  aj  >  02—  >  cr„. 

(it)  Denoting  the  balanced  realization  by  {Ab,Bb,Cb),  compute  the  component  cost  for  the 
state  Xb,i  in  balanced  coordinates:  Vb,i  =  a,C^(:,  i)C|,(:,  i),  w'here  Cb(:,j)  is  the  column 
of  Cb- 

(in)  Perform  a  permutation  transformation  on  the  balanced  state  vector  Iq  =  TaXb  such  that  in 
the  new  coordinates,  the  component  cost  is  sorted  in  a  descending  order,  or,  equivalently, 
Va,i  >  Vaj  for  i  <  j,  where  Uq,,-  is  the  component  cost  associated  with  Iq.,. 


(iv)  Denoting  {Aa-  Ba.Ca)  the  triple  after  the  above  transformation,  partition 


An  — 


Aa,ll 

Aa.21 


>iQ.12 

-4a. 22 


,  Bo  = 


Ba.\ 

Ba.2 

Ixn 


•  Co  =  [Ca.\  Cjo]. 


where  Aa,n  €  R"”’ , 5a,i  €  R"'"^”'.Ca,i  €  R  ^ .  Note  that  the  triple  (Aa,u-.Ba,i^ 
Co,i)  is  a  reduced-order  model  by  using  component  cost  analysis  in  balanced  coordinates. 


(v)  Choose  the  initial  system  matrices  in  the  sorted  component  cost  coordinates  as 


-4o,o  = 


la.ll 

0  A 


<1.22  J 


»  Bafi  = 


Ba,1 

0 


?  Cafi  =  [Ca,l  0]. 


where  Aa.n,  Aa,22,  5q,i,  and  Ca,i  are  given  in  (iv).  The  initial  system  triple  (Ao,  Bo,Co)  is 
obtained  by  transforming  (Aa.o,  Ba,o-,Ca,o)  back  into  the  original  coordinates  using  To  and 
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Tfc.  Next,  form  an  augmented  system  consisting  of  {Ao,Bo,Co)  and  (>lo,n)-5a,iiiC’a,n) 
and  compute  the  initial  guess  Qo  and  Po  using  (2.22)  and  (2.23),  respectively.  Since 
{Ao,Bo,  Co)  is  a  order  nonminimal  model  whose  minimal  realization  can  be  represented 
by  a  minimal  nj^-order  triple  (/la, ii, -Ba.u, C'o.ii),  {Qo,Po)  is  a  solution  of  the  optimal 
projection  equations  corresponding  to  the  initial  system  (i.e.,  (4.5)-(4.8)  with  A  =  0). 


Remark  4.1.  Another  option  for  choosing  the  initial  system  is  based  on  the  triple  (Aj,,  Bt,,Cb) 
obtained  in  (ii)  which  describes  the  system  in  balanced  coordinates.  In  particular,  partition 

Bb,\ 


Ab  = 


>16,11  /l6,12 
^6,21  ^6,22 


,  Bb  = 


D  ’M  >  [^6,1  ^6,2], 

.06,2  , 


where  Ab,i\  €  R"’"  ,  5b,i  6  R""*^”’,C6,i  €  R'^”".  Note  that  the  triple  (Ab,n,5(,.i,C6,i)  is 

a  reduced-order  model  by  using  the  balanced  reduction  method  (Moore  1981).  Now,  foDow  the 
procedure  stated  in  (u)  to  construct  (Ao,jBoiCo)  and  {Qo',Po)  in  the  original  coordinates. 


5.  Illustrative  Numerical  Examples 

This  section  contains  results  and  observations  obtained  on  three  examples.  It  is  assumed 
V  =  R  =  I  ioT  each  example  and  the  cost  J  is  computed  using  (2.5b).  Using  these  examples, 
we  compare  different  algorithm  options.  In  particular,  we  desire  to  compare  the  the  speed  of  the 
algorithm  with  various  prediction  options  and  with  the  two  basis  options  for  solving  the  coupled 
Lyapunov  equations.  The  comparison  are  aU  based  on  a  MATLAB  implementation  of  the  algorithm 
and  the  program  in  each  case  was  run  on  a  386,  40  MHz  PC.  Unless  otherwise  stated,  the  initial 
system  So  and  the  initial  estimate  (Qo!  Po)  for  all  the  solutions  are  determined  using  the  algorithms 
described  in  Section  4.4.1. 


Example  5.1.  (Villemagne  and  Skelton  1987).  The  system  given  by 


A  = 

■-1  3  O' 

-1  -1  1 

,  B  = 

‘-2‘ 

2 

4  -5  -4 

4 

C  =  [1  0  0], 


is  to  be  reduced  to  an  optimal  pCorder  model.  We  follow  the  algorithm  described  in  Section 
4.2  and  perform  a  suboptimal  model  reduction  using  component  cost  analysis  to  construct  the 
initial  system  and  initial  guess.  The  corresponding  optimal  reduced-order  model  obtained  from  the 
homotopy  algorithm  is 


Am  =  -10.4365,  Bm  =  -1.5972,  Cm  =  1.5972. 
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This  model  yields  a  cost  J  =  1.6882,  which  has  the  same  value  as  the  cost  obtained  in  Zigic  et 
al.  (1993a).  However,  if  a  different  initial  system  which  is  based  on  the  balanced  reduction  as 
described  in  Remark  4.1  is  chosen,  we  obtain 


Am  =  -0.2863,  Bm  =  0.8152,  Cm  =  0.8152. 


This  model  yields  a  cost  J  =  1.2288  which  is  smaller  than  the  above  cost  and  is  the  same  as  the 
cost  obtained  in  Ge  ef  al.  (1993a,1993b).  Thus,  using  this  example  we  demonstrate  that  different 
optimal  reduced-order  models  may  be  obtained  if  the  initial  system  is  different.  This  phenomenon 
was  also  observed  by  Ge  et  al.  (1993a,1993b). 


Example  5.2.  (Hickin  and  Sinha  1980).  The  following  plant 


-  -6.2036 

15.0540 

-9.8726 

-376.5800 

251.3200 

-162.2400 

66.8270  ■ 

0.5300 

-2.0176 

1.4363 

0 

0 

0 

0 

16.8460 

25.0790 

-43.5550 

0 

0 

0 

0 

377.4000 

-89.4490 

-162.8300 

57.9980 

-65.5140 

68.5790 

157.5700 

0 

0 

0 

107.2500 

-118.0500 

0 

0 

0.3699 

-0.1445 

-0.2630 

-0.6472 

0.4995 

-0.2113 

0 

0 

0 

0 

0 

0 

376.9900 

0 

B  = 


■  89.3530 
376.9900 
0 
0 
0 
0 
0 


0  - 

0 

0 

0 

0 

0.2113 
0  . 


0  0 
0  0 


0  0  10 
0  0  0  1 


is  to  be  reduced  to  an  optimal  2’^‘^-order  model. 


We  use  this  example  to  illustrate  the  effects  with  various  prediction  options.  Table  5.1  shows 
some  of  the  run  time  statistics  of  the  program  for  acquiring  the  optimal  reduced-order  model 
(rim  =  2)  for  this  example  when  the  diagonalizing  basis  was  chosen  in  solving  the  coupled  Lyapunov 
equations,  and  various  prediction  options  were  used.  The  table  compares  the  number  of  floating 
point  operations,  the  actual  run  time,  the  number  of  predictions  and  corrections  performed,  and 
the  minimum  and  maximum  homotopy  step  sizes  for  each  prediction  option.  From  the  table,  note 
that  the  homotopy  path  of  the  option  with  no  prediction  advanced  extremely  slow’  and  the  step 
size  was  reduced  to  a  value  less  than  10“^^.  This  inefficiency  of  the  homotopy  algorithm  with  no 
prediction  is  explained  using  Figure  5.1  and  5.2  which  show  the  behavior  of  1|C?(A)||f'  and  ||P(A)||p 
with  respect  to  A,  respectively,  and  hence  reveal  the  magnitudes  of  the  changes  of  Q{X)  and  P(X) 
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along  the  homotopy  path.  Both  figures  indicate  steep  slopes  of  the  ||C?('^)||f  and  ||/’(A)||f  curves 
when  A  <  0.2.  The  option  with  no  prediction  actually  sets  Q(A+AA)  =  C?(A)  and  .P(A+AA)  =  P(A), 
which  implies  that  this  option  predicts  the  curves  of  Figures  5.1  and  5.2  advancing  horizontally. 
However,  these  figures  show  that  when  A  <  0.2  this  prediction  is  very  poor.  Therefore,  as  shown  in 
Table  5.1,  even  with  an  extremely  small  step  size  (10”^^),  it  is  difficult  for  the  no-prediction  option 
to  advance  at  certain  points  along  the  homotopy  path. 


Prediction 

Option 

Megaflops 

RealTime 

(sec.) 

Predictions/ 

Corrections 

Minimum 
Step  Size 

Maximum 
Step  Size 

None 

>  208 

>  3114 

>  166 

<  10-1“* 

Linear 

33.4 

488 

59 

0.01 

|imi[g^|||||||||| 

Cubic 

22.8 

341 

40 

0.01 

0.16 

Table  5.1.  Run-Time  Statistics  of  Example  2  with  Intermediate  ^*  =  5  •  10"“*. 


Also,  as  would  be  expected,  Table  5.1  indicates  that  the  algorithm  using  the  cubic  spline 
prediction  is  more  efficient  (by  about  50%)  than  the  algorithm  implementing  the  linear  prediction 
option  for  this  case,  and  both  linear  and  cubic  spline  predictions  are  far  more  efficient  than  using 
no  prediction  at  all.  The  improvement  in  efficiency  with  cubic  spline  prediction  increases  when 
the  intermediate  error  tolerance  is  reduced,  because  in  addition  to  the  current  data  point  and  its 
gradient  used  by  linear  prediction,  the  cubic  spline  prediction  also  utilizes  the  past  data  point  and 
its  gradient  along  the  homotopy  path.  This  additional  information  becomes  more  accurate  with  a 
tighter  error  tolerance.  The  ability  to  predict  along  the  curve  described  by  the  changing  parameters 
is  one  of  the  practical  benefits  of  formulating  an  optimization  problem  in  terms  of  a  homotopy. 


It  should  be  noted  that  both  the  linear  and  cubic  spline  prediction  cases  used  the  same  final 
correction  tolerance  and  yielded  the  same  optimal  2"‘^-order  model: 


.4. 


-0.1997  0.5045 

-0.5044  -13.27.50 


Br 


14.9616  -0.0454 

18.4615  0.3655 


-0.0085  -0.2234 

-14.9617  18.4638 


with  a  cost  J  =  23249.3.  The  normalized  output  difference  between  the  reduced-order  model  and 
the  original  plant,  V ,  is  15.2%  for  optima)  reduced-order  model  and  35.4% 

for  the  suboptimal  reduced-order  model  obtained  by  balancing  or  the  component  cost  analysis  in 
balanced  coordinates.  (For  this  problem  the  above  two  suboptimal  reduction  methods  yield  the 
same  reduced-order  model.) 


Example  5.3.  (Collins  ei  al.  1991)  The  given  system  is  a  state  space  model  of  the  transfer 
function  between  a  torque  actuator  and  an  approximately  collocated  torsional  rate  sensor  for  the 
.4.CES  structure  (Irwin  el  al.  1988).  This  SISO  system  is  of  order  n  =  17  and  with  the  following 
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plant  matrices 


A  =  block-diag( 


-0.0251 

-3.8433 


3.8433 

-0.0251 


-0.0368  4.9057 

-4.9057  -0.0368 


-0.0485  8.9654  ] 

-8.9654  -0.0485]  ’ 


■  -0.0649 

12.0770' 

■  -0.4281 

14.6984  ■ 

■  -0.1351 

15.4179  ■ 

-12.0770 

-0.0649 

-14.6984 

-0.4281  _ 

-15.4179 

-0.1351  _ 

■  -5.1522  51.4577 

-51.4577  -5.1522 

5"^  =  [0.0017  0.0436  -  0.0031  0.0178  0.0117  0.0415  -  0.0162  0.0148  -  0.0529 
-0.2765  -  0.2988  -0.0188  0.4444  1.7120  -  1.6142  -  2.6348  -  4.8879-10"''], 


-0.0320  73.5133 

-73.5133  -0.0320 


,-92.3998), 


C  =  [-0.0177  0.0266  0.0097  0.0878  -  0.0057  0.0133  -  0.0152  0.0264  0.0037 
-0.0090  -  0.0051  0.0181  0.0165  0.0052  -  0.0077  0.0026  184.7996]. 

An  optimal  reduced-order  model  with  =  6  is  obtained 


-  -0.0386 

73.5136 

0.0083 

0.0227 

-0.0381 

-0.0303  ■ 

-73.5136 

-0.0253 

-0.0059 

-0.0212 

0.0345 

0.0220 

-0.0083 

-0.0059 

-0.0055 

-3.8545 

0.2623 

0.0228 

0.0227 

0.0212 

3.8545 

-0.0541 

0.1001 

0.5725 

-0.0381 

-0.0345 

-0.2623 

0.1001 

-0.1879 

-15.3794 

.  0.0303 

0.0220 

0.0228 

-0.5725 

15.3794 

-0.0970  . 

• -0.1229- 

- -0.1229- 

-0.0995 

0.0995 

-0.0123 

0.0123 

0.0386 

,  Cm 

0.0386 

-0.0640 

-0.0640 

.  0.0456  . 

.-0.0456. 

This  model  yields  a  cost  J  =  6.9521  -10 

r 

Table  5.2  shows  a  comparison  of  the  algorithms  for  solving  the  optimal  reduced-order  model 
(Um  =  6)  for  this  example  when  the  hnear  prediction  is  chosen  and  various  basis  options  were  used 
in  solving  the  coupled  Lyapunov  equations.  The  results  indicate  that  the  diagonalizing  option  saves 


about  50%  of  computation  time  over  the  Schur-form  option  for  this  particular  example. 


Basis 

RealTime 

Predictions 

Option 

Megaflops 

(sec.) 

&  Corrections 

Diagonal 

145 

897 

14 

Schur  Form 

310.5 

1343 

14 

Table  5*2.  Run-Time  of  Example  5.3  using  Different  Basis  in  Solving  Coupled  Lyapunov  Equations. 
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As  noted  in  Zigic  et  al.  (1993a),  it  took  77  hours  to  solve  for  an  optimal  reduced-order  model 
for  this  example  using  a  DEC  work  station.  The  efficient  solver  for  the  coupled  modified  Lyapunov 
equations  and  the  selection  of  the  initial  estimates  near  the  optimal  solution  significantly  reduce 
the  computational  time  (to  about  15  to  25  minutes  on  a  386,  40  MHz  PC,  depending  on  the  basis 
option).  In  particular,  to  solve  for  the  6‘^-order  optimal  model  which  has  n  =  17,  =  6,  /  = 

m  =  1,  the  approach  described  in  Appendix  B  requires  solving  m.  =  nmim  +  /)  =  12  Lyapunov 
equations  and  inverting  a  12  x  12  matrix  for  each  prediction  or  correction  step  which  averaged 
about  13.7  Megaflops  operations  (Schur  form  basis).  On  the  other  hand,  the  approach  proposed  in 
Zigic  et  al.  (1993a)  involves  the  computation  of  the  kernel  of  a  Jacobian  matrix  for  each  tangent 
vector  computation.  The  Jacobian  is  constructed  by  exploiting  the  rank  condition  (2.18)  and  has 
a  dimension  of  2nnm  +  rows  and  2nm  -f  -f  1  or,  a  240  x  241  matrix  for  this  example. 
The  kernel  is  found  by  computing  a  QR  factorization  of  the  Jacobian  matrix  then  using  a  back 
substitution.  By  simulation,  a  typical  flop  counts  for  the  MATLAB’s  QR  decomposition  for  a  real 
n  X  (n  1)  matrix  is  about  3n^,  which  implies  about  40  Megaflops  for  the  QR  decomposition  of 
the  Jacobian  matrix  for  this  example.  This  simple  analysis  illustrates  the  improved  efficiency  of 
the  the  approach  proposed  in  this  paper  over  previous  homotopy  approaches  based  on  the  optimal 
projection  equations.  Increased  efficiency  was  also  due  to  better  selection  of  the  initial  system. 

6.  Conclusions 

This  paper  has  presented  a  new  homotopy  algorithm  for  the  synthesis  of  H2  optimal  reduced- 
order  models  based  on  directly  solving  the  optimal  projection  equations.  The  previous  optimal 
projection  equations  based  homotopy  algorithms  (Zigic  et  al.  1993a)  are  numerically  robust  but 
suffer  from  large  dimensionality.  The  number  of  variables  associated  with  this  approach  is  of  order 
rnirr,-  By  parameterizing  the  reduced-order  model,  the  gradient-based  homotopy  algorithms  (Ge  et 
al.  1993a. 1993b)  are  more  computationally  efficient,  but  may  cause  numerical  dll-conditioning.  By 
using  the  results  of  Richter  et  al.  (1993)  to  efficiently  solve  a  pair  of  coupled  Lyapunov  equations, 
the  effective  number  of  variables  associated  with  this  approach  is  reduced  to  n„,(m  -h  /),  which 
is  identical  to  the  dimension  of  the  homotopy  Jacobian  inverted  in  the  minimal  parameterization 
approach  of  Ge  et  al.  (1993a,  1993b).  The  examples  of  the  previous  section  illustrated  some  of  the 
features  of  the  various  algorithm  options  and  some  effects  of  the  initialization  schemes. 
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Appendix  A.  Formulation  of  the  Derivative  and  Correction  Equations 


Before  deriving  the  derivative  and  correction  equations  (4.14)-(4.17),  we  state  the  following 
useful  properties  about  the  derivatives  of  the  contragredient  transformation  of  {Q,P)- 

Note  that  it  follows  from  (4.9)-(4.11)  that  r(A)  can  be  expressed  as 

r(A)  =  Qi\)U'^{X)A\X)U{X)  =  Q{X)Ui{X)Q-\X)U^{X),  (A.l) 

or 

r(A)  =  WiX)A\X)W'^iX)P{X)  =  Wi(A)n-'(A)Mf  (A)P(A),  (A.2) 

where 

At(A)=  ol- 

. 

The  representations  of  r(A)  given  by  (A.l)  and  (A.2)  are  used  below  as  a  convenient  way  of  ex¬ 
pressing  the  derivative  equations  partially  in  terms  of  Q{X)  and  P(A)  as  opposed  to  expressing  the 
derivative  equations  only  in  terms  of  l^i(A),  l7i(A),  and  17(A). 

Differentiating  (A.l)  or  (A.2),  gives  the  following  expressions  for  f 

f  =  +  Qiihn-'^v^  +  c/ifi-'nn-'  +  (aa) 

or 

f  =  VFjQ-'Vlf  >  -f  (VTiD-' -f  )F,  (A.5) 

with 

(A.6) 

dX 

since  Q  is  diagonal.  Below,  we  derive  the  matrix  equations  that  can  be  used  to  solve  for  the 
derivatives  and  corrections. 

A.l.  The  Derivative  Equations 

Differentiating  (4.5)  and  (4.6)  and  using  (A.4)-(A.6),  yields 

0  =  AuQ  +  QA^  +  Rq  +  +  Vq  +  (^*7) 

where 

.4„  =  .4  +  (Jr.  -  ,  (A.8) 

Rq  =  QiUya-^Jj  -  C/i  17-^170-’ )£(/„  -  rf,  (A.9) 

^  [A  +  (/„  -  ^T)tu,Q-HJ^]Q,  (A.IO) 
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and 


(AM) 


0  —  A^P  +  P  A^  +  +  Rp  +  V^p  + 


where 


A^.  =  A  +  W^n-'^W^Liln-T),  {A.12) 

Rp  i  P{Wi(l-'^W^  -  VFiQ-’fiQ-^VF^  +  H^in-^U^i'^)i:(7„  -  r),  (A13) 

Vp  ^  P[A  +  £(/„  -  ir)].  (A.U) 

Note  that  it  follows  from  (4.1)  that 

A  =  Af  —  Ao,  B  —  Bf  —  Bq,  C  =  C  j  —  Co, 

V^V}-Vo,  R  =  Rf-Ro, 

t  =  BVB'^  +  BVB'^  +  BVB'^  ,  t  =  C'^RC  +  C'^RC  +  C'^RC. 

Next,  differentiating  (4.9)  and  (4.10),  yields 

d  =  W^aW^  +  14^,014^7'  +  44^1^14"^,  (A.15) 

P  =  LhUU^  +  UiClU]^  +  UiQilJ .  (A.16) 

Furthermore,  differentiating  (4.12b)  with  respect  to  A  gives 

0  =  UW+  UW  =  14^1  +  Wj .  (A.U) 


A. 2.  The  Correction  Equations 

The  correction  equations  are  developed  with  A  at  some  fixed  value,  say  A*.  The  derivation  of 
the  correction  equation  is  based  on  the  relationship  between  Newton’s  method  and  a  particular 
homotopy.  Below,  we  use  the  notation 

m=%-  (A.18) 

Let  /  :  R"  R"  be  C^  continuous  and  consider  the  equation 

O  =  /(0).  (A. 19) 
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If  is  the  current  approximation  to  the  solution  of  (A. 19),  then  the  Newton  correction  (Fletcher 
1987)  Ad  is  given  by 

^(•+1)  _  g(i)  ^  (^,20) 

where 

e  =  f{e^'^).  (A.21) 

Now,  let  0^'^  be  an  approximation  to  6  satisfying  (A. 19).  Then  with  e  given  by  (A.21)  construct 
the  following  homotopy  to  solve  (A. 19) 

{l-fi)e  =  m/3)),  /9€[0,1].  (A.22) 

Note  that  at  /?  =  0,  (A. 22)  has  solution  ^(0)  =  6^'^  while  0(1)  satisfies  (A. 19).  Then  differentiating 
(A.22)  with  respect  to  (5  gives 

do 

=-/(«<■>)-■€.  (A.23) 

Remark  A.l.  Note  that  the  Newton  correction  AS  in  (A.20)  and  the  derivative  ^\i3=q  in 
(A.23)  are  identical.  Hence,  the  Newton  correction  A0  can  be  found  by  constructing  a  homotopy 
of  the  form  (A.22)  and  solving  for  the  resulting  derivative  |||^=o-  As  seen  below,  this  insight  is 
particularly  useful  when  deriving  Newton  corrections  for  equations  that  have  a  matrix  structure. 

Now,  we  use  the  insights  of  Remark  A.l  to  derive  the  equations  that  need  to  be  solved  for 
the  Newton  corrections  (AQ.AP),  or,  equivalently,  {AWi,AUi,AQ).  We  begin  by  recaUing  that 
A  is  assumed  to  have  some  fixed  value,  say  A*.  Also,  it  is  assumed  that  (Q",  F*,  Wj*,  C7*,  fl*) 
is  the  current  approximation  of  (0(-^"),.^(A“),  Wi(A'),C/i(A*),fi(A*))  and  that  and  Ep  are 
respectively  the  errors  in  equations  (4.5)  and  (4.6)  with  A  =  A*  and  Q(A)  and  F(A)  replaced  by  Q’ 
and  P",  respectively. 

Next,  we  form  the  homotopy 

r- 

(1  -  p)E’^  =  AQ{3)  +  Q{3)A'^  +  r(/3)E  +  Sr^(^)  +  (A.24) 

(1  -  3)Ep  =  A'^P{3)  +  P(^)-4  +  rT(/?)i:  +  tT{3)  +  r^(5)£r(/?).  (.4.25) 

Here,  {A,B,C.R,V)  =  (A(A’).P(A*),C(A*),P(A*),  V(A’)),  i.e.,  the  system  matrices  are  assumed 
to  be  evaluated  at  A  =  A*  and  at  ^  =  0,  (Q(0),  P(0),  t(0))  is  the  current  approximation.  Dif¬ 
ferentiating  (A.24)  and  (.4.25)  with  respect  to  3,  noting  the  identity  of  (A.4)-(.4.6)  with  f  now 
representing  and  using  Remark  A.l  to  make  the  replacements 

.  A  A  dQ  A  ^  dp , 

^^-■^1^=0,  (A.26a,fc) 


24 


yields 

0  =  A„aO  + +  +  +  (A.27) 

where 

A„  =  A  +  (/„-r)Ef/ifi-^t/7, 

R^q  =  QiAUiil-'^Uj  -  AU^ )i:{I^  -  rf, 

and 

0  =  aIaP  +  APA^  + R^p  + Rl^  + Ep,  (A.28) 

where 

A^  =  A  +  S:(/„  -  r), 

)£(/„  -  r). 

Next,  replacing  A  with  /3  in  (4.9),  (4.10),  and  (4.12)  and  differentiating  them  with  respect  to 
0,  the  following  equations  are  derived, 


where 


AQ  =  AWiQW:^  +  +  M^iflAH^T",  (/1.29) 

AP  =  AUiQU^  +  UiAnU^  +  Ui^AU^,  (>1.30) 

0  =  AU^VI\  +  U^AW,,  (^.31) 

Ay.sgle=o,  (1.32) 


Appendix  B.  Efficient  Computation  of  the  Solution  to  the  Prediction  and  Correction 
Equations 


This  appendix  presents  a  solution  procedure  using  Richter  et  al.  (1993)  for  efficiently  solving 
the  prediction  equations  (4.14)-(4.15)  and  the  correction  equations  (4.16)-(4.17).  We  commence 
b\  recognizing  that  (4.14)— (4.15)  and  (4.16)— (4.17)  have  the  foUowing  generic  form: 

0  =  A„^  +  ^A^+^i((0,>)  +  P<j.  (P.l) 

Q  =  AlP+pAu.  +  Pi{i,P)+Fp.  (B.2) 
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where  the  linear  operators  T\  :  XjS"^"  gnxn  — >  S"^"  are  defined  by 

(^.3) 

T^(q,P)  t  Rp{Ci,  P)  +  4(4  >),  {BA) 

and  and  Fp  are  constant  forcing  terms.  It  is  easy  to  verify  that  (Q,  P,F\,F2,  F^,  Fp)  in  the 
above  equations  represents  {Q,  P,  Rq  +  R'^yRp  +  Rp,  Vq  +  +  4o’  +  ^p  Rpo')  (4.14)- 

(4.15)  and  (AQ.Ap ,  R^q  +  R^^,  R^p  +  R'^p,  E^,  Ep)  in  (4.16)-(4.17),  respectively.  Our  goal  now 
is  to  find  for  some  integers  mj  and  m2  (as  small  as  possible)  linear  operators  (f>i  :  XjS"''"  -+  R”*’, 
Gi  :  4>2  :  XfS”^"  -  R’^^,  G2  :  R^^  ^  such  that 

•^i(4^)  =  ai(<^i(4^)),  {B.ba) 

y^2{d,P)  =  Q2{Mi.h)-  (5.56) 


First,  let  and  be  the  transformation  matrices  such  that  T~''- and  T~^  A  are  in 
suitable  form  according  to  the  basis  option  described  in  Section  4.3.2.  Next,  make  the  replacements 


T-iyi  T 


A  rp 

^  w  Wi 


Q  -  T-^QT-^, 
Fq  - 

W,  -  r-iVk’:, 
1^2  ^  r-'M’,, 
B-T-^B, 


p  ^  t'^  Pt 

1  J.  ^  jr  ± 
p.  ^  p.T 

P  W  p-^  w-i 

U2  -  4f/2, 

c  -  cr„. 


Then,  in  this  new  basis  we  obtain 


Rq{Q,P)  =  W,QW^T:^T-'^{UiQ-HiJ  - 


^  uj  AUiQ-^ 4 )BVB'^ U2 , 


(5.6a) 


and 


Rp{Q,P)  =  l\^U^TjT^{Vi\?L  (BM) 


Now,  rewrite  (B.6a)  as 


5^(45)  =  Fj,Si{u,n-^iq  -  +  {^fi-'4)SHG^,  {b.i) 
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where  for  some  integers  m,  <  n  and  <  n 


Fa  €  5i,  €  G  R”^"',  Ga  €  R"*’^".  (B.la) 

In  a  similar  way,  we  can  express  Rp{Q^P)  as 

Rp{i,h  =  FbTl(WiQ-'^W^  -  (B.s) 

where  for  some  integers  rrit  <  n  and  n<  <  n 

FseR"^'”',  TiGR'"'^”,  TfiGR”’'"’,  GbGR”'’^".  (R8a) 


The  choice  of  {Fa,  Sl,  Sb,  G a)  in  (B.7)  and  {Fb,  7l,  2/j,  G b)  in  (B.8)  are  not  unique.  The  solution 
procedure  we  discuss  below  is  most  efficient  if  we  minimize  the  products  m^ns  and  7n,nt. 

Using  (B.7),  it  follows  that  4>\{-)  and  ^i(')  in  (B.5)  can  be  defined  by 


MQ,P)  =  veciSL[U,a-'^U^  -  f/ifi-infi-'C/T  ^  Ura-^Uj]SB), 

(B.9) 

and 

Qi{^)  =  Fa  vec-\z)GA  +  C?5[  vec"^(2)]'^/’J, 

(B.IO) 

such  that 

TTl\  —  771571^, 

(B.ll) 

Similarly,  it  follows  from  (B.8)  that  4>2{*}  and  ^2(’)  (B.6)  can  be  defined  by 

4>2{Q,P)  =  vec(rL[u'ifi 

(B.12) 

and 

G2(z)  =  Fb  vec~^(z)GB  +  G^l  vec“^(2)]’^fj , 

(B.13) 

such  that 

m2  =  mtUi, 

(5.14) 

Note  that  it  is  assumed  in  (B.9)  and  (B.12)  that  and  tl  are  obtained  from  (A.15)-(A.17), 

or,  equivalently,  (A.29)-{A.31).  A  procedure  to  compute  Wi,Uu  and  tl  given  ^  and  P  is  presented 
in  Appendix  C. 


Now,  with  the  definitions  (B.9),  (B.IO),  (B.12),  and  (B.13),  the  solution  procedure  for  coupled, 
modified  Lyapunov  equations  described  in  Richter  et  al.  (1993)  is  applied  to  solve  for  (^,  P)  in  (B.l) 
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and  (B.2).  With  the  above  formulation,  the  efficiency  of  the  coupled  Lyapunov  equations  solver  is 
realized  Richter  et  al.  (1993)  by  exploiting  the  low  rank  properties  of  the  coupling  terms.  Here, 
we  illustrate  this  by  an  example  solving  the  prediction  equations.  Suppose  m,l  <  {n  -  Um)  <  n, 
i.e.,  the  number  of  the  inputs  and  outputs  are  less  than  the  difference  between  the  order  of  the 
original  plant  and  the  desired  reduced-order.  Noting  that  (B.7)  and  (B.8)  are  equivalent  to  (A.9) 
and  (A. 13),  respectively,  to  minimize  mi  =  m^rij  and  m2  =  mtUt,  we  choose 

FA  =  W,n,  =  =  GA  =  VB'^UiWj, 

in  (B.7),  and 

FB  =  u,n,  Tl  =  f/i'^r-'r„,  Tr  =  c'^,  GB  =  RC{in-T), 

in  (B.8).  Thus,  using  (B.7a)  and  (B.8a),  it  follows  that  =  Um,  =  /,  mt  =  n^.  Uf  =  m, 
which  results  in  +  m2  =  ?^m(7n  +  /).  Now,  using  the  solution  procedure  described  in 

Richter  ei  al.  (1993),  to  solve  the  prediction  equations  (B.l)  and  (B.2),  the  primary  computation 
burden  is  to  invert  a  matrix  of  dimension  x  m*  and  to  solve  two  sets  of  m.  +  1  standard 
71  X  n  Lyapunov  equations,  with  one  set  having  as  the  coefficient  matrix  and  the  other  set  with 
coefficient  matrix 

In  comparison,  by  using  Kronecker  algebra  (Brewer  1978)  and  exploiting  the  rank  condition 
(2.18)  of  Q  and  P,  (B.l)  and  (B.2)  can  be  converted  to  the  vector  form  Ax  =  b  where  X  a 
vector  consisting  of  the  independent  elements  of  W^^Ui  and  given  by  (4.12)  and  (4.13).  Hence, 
to  get  the  solution  for  {Q,P),  it  is  required  to  invert  an  {2nnyn  +  ^m)  ^  {2nnm  +  matrix.  The 
approach  proposed  in  Zigic  et  al  (1993a)  involves  the  computation  of  the  kernel  of  a  Jacobian 
matrix.  The  Jacobian  matrix  has  2nnm  +  rows  and  2nm  +  72^  +  1  columns.  The  kernel  is  found 
by  computing  a  QR.  factorization  of  the  Jacobian  matrix  then  using  a  back  substitution.  Thus,  if 
m  <<  n  and  I  <<  n,  which  is  usually  true.  m.  is  sufficiently  small  and  the  algorithm  discussed  in 
this  Appendix  wiD  be  much  more  efficient.  Furthermore,  if  (B.l)  and  (B.2)  are  first  transformed 
to  the  bases  in  which  A^  and  A^^,  are  nearly  diagonal,  respectively,  the  cost  of  computation  can  be 
reduced  significantly.  The  comparison  in  computation  time  is  discussed  in  Example  5.3. 


28 


Appendix  C.  Conversion  from  (QyP)  to 

Note  that  the  following  procedure  is  valid  only  in  the  original  basis.  It  is  desired  to  compute 
ill  and  17  satisfying  (A.15)-(A.17).  Note  that  (A. 15)  implies 

U^Wi  =  ,  C/T  W2  =  0,  U^Wi  =  0.  (C.l) 

Pre-  and  post-multiplying  (4.22)  by  U  and  respectively  gives 

i  =  0)+[“  “]+[“](]£,)’■,  (C.2) 

where 


0  =  u0u'^, 

^  UWi  = 


Similarly,  pre-  and  post-multiplying  (A. 16)  by  W'^  and  W  respectively  gives 


i  =  01+1“  °]  + 


where 


(C.3) 

(C.4) 

(C.5) 


P  ^  W'^PW, 

•  .  T- 

4  W^Ui  = 

WjUl 


Partition  and  f/j  as 

\Kn 

Mil  = 

.  r^nl 


It  then  foUows  from  (C.4)  and  (C.7)-(C.9)  that  (A.17)  is  equivalent  to 

i£n  =  -I>n- 


(C.6) 

(C.7) 

(C.8) 

(C.9) 

(C.IO) 
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It  now  follows  from  (C.8)  that  (C.2)  is  equivalent  to 


■4.. 

'Kn^  O' 

■  n  o' 

+ 

+ 

■4.  »  - 

1£2iI^  0_ 

0 

0 

1 _ 

0  0 

and  from  (C.9)  that  (C.5)  is  equivalent  to 


£11 

(£2i)''' 

1 

0 

'n 

0' 

ZZ. 

+ 

+ 

•ii 

0 

Cjifi  0_ 

0 

0^ 

- 1 

0 

0 

-  j 

Furthermore,  (C.ll)  is  equivalent  to 

4i  +  + 

Similarly,  equation  (C.12)  is  equivalent  to 


(C.ll) 


(C.12) 


(C.13) 

(C.14) 


£ii  —  ^11^1  +  n  + 

£21  ~  Co]  II. 


Now,  (C.14)  and  (C.16)  imply  respectively  that 


(C.15) 

(C.16) 


.^21  ~  £21  ^  ^  • 

Furthermore,  substituting  (C.IO)  into  (C.13)  yields 

Q.11  ~  . 


(C.17) 

(C.18) 


(C.19) 


Denote  the  {i,j)  elements  of  ,  and  £„  respectively  by  p..,  and  Then  we  can 

rewrite  (C.15)  and  (C.19)  as 


where 


Eij  -  +  Sij^i  + 

€  {l,2,...,n,n}, 

(C.20) 

iij  - 

t,;  €  {l,2,...,n„,},  . 

(C.21) 

r  ^  [  1  for 

=  t  0  tor 

i  =  j 
i  j. 

(C.22) 
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Next,  assume  i  =  j.  Then  subtracting  (C.21)  from  (C.20)  gives 


(C.23) 


Now,  assume  i  ^  j.  Multiplying  (C.20)  by  and  adding  the  resultant  equations  to  (C.21) 

gives 


(C.24a) 


or,  if  w,-  =  Wj, 


(C.246) 


Now,  is  defined  by  (C.23)  and  (C.24)  and  £21  (C.18).  ]£ii  is  then  defined  by  (C.IO)  and 

I£2]  by  (C.17).  jilj  and  U_-^  are  now  defined  respectively  by  (C.8)  and  (C.9).  Using  (A. 17)  it  follows 
from  (C.4)  and  (C.7)  that  Wi  and  Ui  are  given  respectively  by 


From  (C.22)  it  follows  that 


which  defines  Ct. 


Wi  = 

Ui  =  u'^iLi. 


Ui 


(C.25) 

(C.26) 


(C.27) 
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Figure  5.1.  HOIIf  vs  A  for  Example  5.2 
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Abstract 


Gradient-based  homotopy  algorithms  have  previously  been  developed  for  synthesizing  op¬ 
timal  reduced-order  dynamic  compensators.  These  algorithms  are  made  efficient  and  avoid  high- 
order  singularities  along  the  homotopy  path  by  constraining  the  controUer  realization  to  a  minimal 
parameter  basis.  However,  the  resultant  homotopy  algorithms  sometimes  experience  numerical  iU- 
conditioning  or  failure  due  to  the  minimal  parameterization  constraint.  This  paper  presents  a  new 
homotopy  algorithm  which  is  based  on  solving  the  optimal  projection  equations,  a  set  of  coupled 
Riccati  and  Lyapunov  equations  that  characterize  the  optimal  reduced-order  dynamic  compensator. 
Path  foUowing  in  the  proposed  algorithm  is  accomplished  using  a  predictor/corrector  scheme  that 
computes  the  prediction  and  correction  steps  by  efficiently  solving  a  set  of  four  Lyapunov  equations 
coupled  by  relatively  low  rank  linear  operators.  The  algorithm  does  not  suffer  from  iU-conditioning 
due  to  constraining  the  controUer  basis  and  often  exhibits  better  numerical  properties  than  the 
gradient-based  homotopy  algorithms. 
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Introduction 


The  design  of  reduced-order  dynamic  compensators  is  of  practical  importance  due  to  limitations 
on  the  throughput  of  control  processors.  Hence,  an  important  research  area  has  involved  the 
development  of  techniques  for  synthesizing  Hi  optimal  reduced-order  compensators.  Most  of  the 
techniques  for  designing  optimal  reduced-order  compensators  have  been  gradient-based  parameter 
optimization  methods  which  represent  the  controller  by  some  parameter  vector  and  attempt  to  find 
a  vector  for  which  the  gradient  of  the  performance  index  is  zero,  or,  equivalently,  the  cost  functional 
is  minimal. 

In  the  survey  paper  by  Makila  and  Toivonen^  several  gradient- based  approaches  were  discussed. 
Levine-Athans-type  algorithms'”^  are  based  on  using  some  standard  optimization  methods  (e.g., 
conjugate  gradient  algorithms)  to  iteratively  solve  the  necessary  conditions  of  optimality  which 
minimize  the  cost  increment.  This  approach  requires  the  solution  of  a  nonhnear  matrix  equation  at 
each  correction  step  but  guarantees  a  cost  descent  direction  without  a  line  search.  The  Anderson- 
Moore  algorithm*  is  based  on  minimizing  a  quadratic,  positive-definite  approximation  of  the  second- 
order  Taylor  series  expansion  of  the  cost  function  increment.  The  descent  Anderson-Moore  approach 
utilizes  gradient  search  schemes  to  guarantee  the  cost  is  reduced  at  each  iteration  and  enhance 
convergence  to  a  stationary  point  of  the  cost  function®’^®.  For  Newton-like  approaches^',  instead  of 
approximating  the  Hessian  of  the  cost  functional  with  a  positive-definite  matrix,  the  actual  second- 
order  expansion  is  minimized  which  involves  computing  the  Newton  correction  step  as  the  solution 
of  a  system  of  linear  matrix  equations  at  each  iteration. 

Recently,  homotopy  algorithms  have  been  developed  for  the  synthesis  of  optimal  reduced-order 
compensators'^”'®.  A  gradient-based  algorithm  has  been  developed'®  that  is  made  efficient  and 
avoids  high  order  singularities  along  the  homotopy  path  by  constraining  the  controller  realization  to 
a  minimal  parameterization  basis.  These  algorithms'®  sometimes  exhibits  numerical  ill-conditioning 
or  can  even  fail  due  to  the  basis  constraint.  This  is  because  minimal  parameterizations  of  a  given 
form  may  not  exist  at  each  point  along  the  homotopy  path  or  may  force  the  algorithm  to  be 
iU-conditioned  when  the  transformation  to  the  given  basis  is  ill-conditioned.  Nonminimal  param¬ 
eterizations  exhibit  singularities  along  the  homotopy  path  that  can  be  handled  heuristically  but 
may  also  lead  to  ill-conditioning.  This  iU-conditioning  is  also  observed  outside  of  the  context  of 
homotopy  algorithms  by  Kuhn  and  Schmidt'®.  Similar  conclusions  are  presented  in  Refs.  17  and 
18  for  the  closely  related  H<i  optimal  model  reduction  problem. 
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The  homotopy  algorithm  of  Ref.  19  was  based  on  solving  the  optimal  projection  equations 
developed  by  Hyland  and  Bernstein^^.  The  optimal  projection  equations  are  a  set  of  coupled 
Riccati  and  Lyapunov  equations  that  characterize  optimal  reduced-order  dynamic  compensators. 
The  equations  decouple  and  the  Riccati  equations  specialize  to  the  standard  LQG  Riccati  equations 
when  the  compensator  is  constrained  to  be  full-order.  The  initial  homotopy  algorithm'^  for  solving 
the  optimal  projection  equations  utilized  a  very  crude  path  following  scheme  in  which  the  Riccati 
equations  and  Lyapunov  equations  were  not  updated  simultaneously.  This  caused  the  algorithm  to 
exhibit  poor  convergence  properties,  especially  as  the  control  authority  was  increased. 

This  paper  presents  a  homotopy  algorithm  to  solve  the  optimal  projection  equations  that  simul¬ 
taneously  updates  the  coupled  Riccati  and  Lyapunov  equations.  The  path  following  is  accomplished 
using  a  predictor/corrector  integration  scheme  that  computes  the  prediction  and  correction  steps 
by  solving  a  set  of  four  Lyapunov  equations  coupled  by  relatively  low  rank  linear  operators.  These 
equations  are  solved  efficiently  by  using  the  technique  presented  in  Ref.  21.  This  helps  to  avoid 
the  very  large  dimensionality  of  similar  algorithms  based  on  the  optimal  projection  equations  for 
H2  model  reduction^^’^^.  A  model  reduction  algorithm  that  uses  a  similar  approach  to  that  used 
here  is  found  in  Ref.  24.  Also,  a  related  algorithm  for  full-order  Maximum  Entropy  robust  design 
is  presented  in  Ref.  25.  These  results  all  show  that  algorithms  based  on  the  optimal  projection 
equations  tend  to  avoid  the  numerical  ill-conditioning  experienced  in  gradient-based  algorithms  due 
to  constraints  on  the  realization  of  the  reduced-order  model  or  controller. 

The  current  homotopy  algorithm,  unlike  some  of  the  previous  algorithms^ assumes 
that  the  homotopy  curve  is  monotonic  with  respect  to  the  homotopy  parameter.  As  discussed  in 
Ref.  13,  this  assumption  may  not  always  be  satisfied.  It  appears  to  be  possible  to  extend  the 
algorithm  to  relax  this  assumption  without  significantly  increasing  the  required  computations  by 
using  a  technique  related  to  that  developed  in  Ref.  26.  However,  this  is  a  subject  of  future  research. 

The  paper  is  organized  as  follows.  Section  2  presents  the  optimal  projection  equations  for  the 
H2  reduced-order  control  problem.  Section  3  gives  a  brief  synopsis  of  homotopy  methods.  Next, 
Section  4  develops  a  new  homotopy  algorithm  for  optimal  reduced-order  controller  design  based  on 
the  optimal  projection  equations.  Section  5  illustrates  the  algorithm  with  two  illustrative  examples. 
Finally,  Section  6  presents  the  conclusion. 
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Nomenclature 


IE 

Y>X 
Y  >  X 
Xij  or  ^ij 

X* 


expected  value 

n  X  1  real  vectors,  m  x  n  real  matrices 

Y  -  X  is  nonnegative  definite 

Y  —  X  is  positive  definite 
(i,  j)  element  of  matrix  A" 

Moore-Penrose  generalized  inverse'^^  of  matrix  X 
Group  inverse^^  of  matrix  X 


Ir  ‘  TXT  identity  matrix 

tr  X  trace  of  square  matrix  X 

||A"||p,  \\X\\a  Frobenius  norm  (||Ar||p  =  tr  XX'^),  absolute  norm  (||Ar||A  =  majCjjlA",-j|) 

vec(-)  the  invertible  linear  operator  defined  such  that 

vec(5)  =  [5?  sj  •  •  •5^]'^,  S  € 


=(«■) 


X{:,k) 

Snxn 

X2snxn 


where  sj  €  R'’  denotes  the  column  of  S. 

the  m-dimensional  column  vector  whose  i‘*’  element 
equals  one  and  whose  additional  elements  are  zeros. 

column  of  the  matrix  X  (MATLAB  notation) 
the  space  of  symmetric  matrices  in  R”^” 

gnxn  ^ 


2.  H2  Optimal  Reduced-Order  Dynamic  Compensation 


Consider  the  n‘^-order  linear  time-invariant  plant 


x{t)  =  Ax{t)  +  Bu{t)  +  Diw{t),  (2.1) 

y{t)  =  Cx{t)  +  Du{t)  +  D2w{t),  (2.2) 
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where  {A,B)  is  stabilizable,  {A,C)  is  detectable,  x  6  R",ti  €  €  R',  and  ty  G  R*^  is  a 

standard  white  noise  disturbance  with  intensity  I4  and  rank  D2  =  /•  The  intensities  of  D\‘w{t)  and 
D2‘w{i)  are  thus  given,  respectively,  by  Vi  =  D\Dj  >  0,  and  V2  =  D2D2  >  0.  For  convenience,  we 
assume  that  Vn  =  D\Dj  =  0,  i.e.,  the  plant  disturbance  and  measurement  noise  are  uncorrelated. 
The  goal  of  the  optimal  reduced-order  dynamic  compensation  problem  is  to  determine  an  n‘^-order 
dynamic  compensator 


ic(<)  =  AcXc{t)  +  BcVit), 

(2.3) 

u{t)  =  -CcXcit), 

(2.4) 

which  satisfies  the  following  two  design  criteria: 


(i)  the  closed-loop  system  corresponding  to  (2.1)-(2.4)  given  by 

x(t)  =  Ax{t)  -1-  Dw{t), 


(2.5) 


where 

Di  ■ 

BcDil  ’ 

is  asymptotically  stable;  and 


x(0  = 


■  x{t)  ■ 

,  A  = 

■  A 

1 

bo 

O 

o 

_ 1 

<11 

Xcit) 

BcC 

Ac  ~  BcDCc\ 

r  1 

(2.6) 


(a)  the  steady-state  quadratic  performance  criterion 

t 

J(Ac,Bc,Cc)=  lim  “IE  [[x'^{s)Rix{s)  +  u^(s)R2u{s)]ds,  (2.7) 

i  J 

0 

where  iZi  >  0  and  i?2  >  0,  is  minimized. 

Although  a  cross-weighting  term  of  the  form  2x'^{t)Ri2u{i)  can  also  be  included  in  (2.7), 
we  shall  not  do  so  here  to  facilitate  the  presentation.  With  the  first  criterion,  we  restrict  our 
attention  to  the  set  of  stabilizing  compensators,  Sc  =  {{Ac^  BcyCc)-  A  is  asymptotically  stable} 
which  guarantees  that  the  cost  J  is  finite  and  independent  of  initial  conditions.  The  cost  (2.7)  can 
now  be  expressed  as 

J{Ac,Bc,Cc)  -  lim  IE[x^(t)J?x(i)],  (2.8) 

t— +00 

where 

(2.9) 

Next,  by  introducing  the  performance  variables 


Ri 

0 


0 

CJR2Cc 


where  E  =  [E\  E2Cc],  and  defining  the  transfer  function  from  tn  to  2  by 

H{s)  =  E{sh-A)-^D, 

where  n  =  n  +  nc,  it  can  be  shown  that  when  A  is  asymptotically  stable,  (2.8)  is  given  by 

j{A,,B,,Cc)  =  ii^(^)ii^  = 

For  convenience  we  define  the  matrices  Ri  =  Ej Ei  and  =  Ej E2  which  are  the  weights  for 
the  state  and  control  variables.  Since  A  is  asymptotically  stable,  there  exist  nonnegative-definite 
matrices  Q  G  and  P  G  satisfying  the  closed-loop  steady-state  covariance  equation  and 

its  dual,  i.e., 


0  =  AQ  +  QA'^  +  V, 

(2.11) 

0  =  . 

i'^P  +  PA  +  R, 

(2.12) 

where 

'Vi  O' 

.  0  B.ViBj^ 

■ 

(2.13) 

The  cost  functional  (2.7)  can 

now  be  expressed  as 

J(Ac,Bc,Cc)  =  tr  QR  = 

tr  PV. 

(2.14) 

Before  presenting  the  main  theorem  we  present  a  key  lemma  concerning  nonnegative  definite 
matrices  and  several  definitions. 

Lemma  2.1.^®  Suppose  Q  G  and  P  G  R’^^”  are  symmetric  and  nonnegative-definite  and 

rank  QP  =  n-c.  Then,  the  following  statements  hold: 

(f)  QP  is  diagonalizable  and  has  nonnegative  eigenvalues. 

{ii)  The  n  x  n  matrix 

T^QPiQpf,  (2.15) 

is  idempotent,  i.e.,  r  is  an  oblique  projection  and 

rank  r  =  n^.  (2.16) 


Thus,  if  T  is  given  by  (2.15),  then  there  exists  a  nonsingular  matrix  W  €  such  that 


T  =  W 


I 


nc 


0 


0 

0 


(2.17) 
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(m)  There  exist  G,  T  €  R"‘^”  and  nonsingular  M  e  such  that 


Qp  =  G'^Mr,  (2.18) 

rG'^  =  In.-  (2.19) 

(in)  If  G,r,  and  M  satisfy  property  {Hi)  then 

rank  G  =  rank  F  =  rank  M  =  ric,  (2.20) 

{Qp)*  =  G'^M-'^r,  (2.21) 

r  =  G'^r,  (2.22) 

tG^  =  G'^,rT  =  T.  (2.23) 


(w)  The  matrices  G,  F,  and  M  satisfying  property  (in')  are  unique  except  for  a  change  of  basis 
in  R"',  i.e.,  if  G',F',  and  M'  also  satisfy  property  (iu),  then  there  exists  nonsingular 
Tc  €  such  that  G'  =  TJG,F'  =  T~^F,M'  =  T~^ MT^.  Furthermore,  all  such  M 

are  diagonalizable  with  positive  eigenvalues. 

{vi)  Finally,  if  rank  Q  =  rank  P  =  rank  QP  =  ric,  there  exists  a  nonsingular  transformation 
W  G  R"^”  such  that 


Q  =  W 

n 

0 

0 

0 

(2.24) 

=  w-'^ 

0 

0 

0 

(2.25) 

where  Q  6  is  diagonal  and  nonsingular.  In  addition, 

Q  =  tQ  =  Qr'^  =  (2.26) 

P  =  t'^P  =  Pt  =  t'^Pt.  (2.27) 


Definition  2.1.  A  triple  {G^M,F)  satisfying  property  {Hi)  of  Lemma  2.1  is  a  projective 
factorization  oi  Qp . 

Definition  2.2.  A  compensator  {Ac  BcCc)  is  an  extremal  of  the  optimal  generalized  fixed- 
order  dynamic  compensation  problem  if  it  satisfies  the  first  order  necessary  conditions  of  optimaUty, 
i.e., 

dJ_  -n  -n 

dAc  ~  dBc  ~  dCc  ~ 
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where  J{Ac,Bc,Cc)  is  defined  by  (2.7). 


Definition  2.3.  A  compensator  {Ac,Bc,Cc)  is  an  admissible  extremal  of  the  optimal  gener¬ 
alized  fixed-order  dynamic  compensation  problem  if  it  is  an  extremal  and  is  also  in  «Sc,  i.e.,  the 
closed-loop  system  is  asymptotically  stable. 

Finally,  for  convenience  in  stating  the  main  results  we  define 

i:  =  c'^vf^c,  i:  =  br^^b'^.  (2.28) 

Theorem  2.1.^°  Suppose  {Ac,Bc,Cc)  is  an  admissible  extremal  of  the  optimal  fixed-order 
dynamic  compensation  problem.  Then,  there  exist  n  x  n  nonnegative-definite  matrices  P,Q,P, 
and  Q  such  that  Ac,  Be,  and  Cc  are  given  by 

Ac  =  r{A-Qt-i:P  +  QC'^Vf^DR^^B'^P)G'^,  (2.29) 

Bc  =  rQC^Vf\  Cc  =  R^^B'^PG^,  (2.30) 

for  some  projective  factorization  (G,  M,  P)  oi  QP  and  such  that  the  foUowing  conditions  are  satis¬ 


fied: 

0  =  PA-f  J7i  -  PEP-f  rJPEPrx,  (2.31) 

0  =  AG-t-gA'^  +  l^i-gEQ-l-rxQEgrJ,  (2.32) 

0  =  (A  -  gE)'^P  +  P(A  -  QE)  +  PEP  -  rJPEPrx,  (2.33) 

0  =  (A-EP)Q  +  g(A-EP)^  +  gEg-rxgEgrJ,  (2.34) 

rank  Q  =  rank  P  =  rank  QP  —  Uc,  (2.35) 

T  =  {QP){QP)*,  T^=In-T.  (2.36) 

Furthermore,  the  minimal  cost  is  given  by 

J{Ac,Bc,Cc)  =  tr[PVi  -H  g(PEP-  rJPEPrx)],  (2.37) 


or,  equivalently, 


J{Ac,Bc,Cc)  =  tr[gPi  +  P{Q^:Q  -  tj^QJ^QtI)]. 


(2.38) 


Conversely,  if  there  exist  n  x  n  nonnegative-definite  matrices  P,  Q,  P,  and  Q  satisfying  (2.31)-(2.36) 
then  the  compensator  {Ac,Bc,Cc)  given  by  (2.29)  and  (2.30)  is  an  extremal  of  the  optimal  fixed- 
order  dynamic  compensation  problem.  Furthermore,  A  is  asymptotically  stable  if  and  only  if  {A,  E) 
is  detectable  (  or,  equivalently,  {A,D)  is  stabilizable). 


Remark  2.1.  Partitioning  Q  and  P  given  by  (2.11)  and  (2.12),  respectively,  as 

Q  = 


Q\  Q\7 
QI7  Q2\ 


P  = 


Pi  P12 
vPn  P2. 

it  follows  from  Ref.  20  that  P,Q,P  and  Q  given  by  (2.31)-(2.36)  can  be  expressed  as 


,Qi  €  6  R"‘^"S 

,Pi  €  R"’^",P2  € 


P  =  Pi  -  Pi2P2"'PS  , 


Q  =  Qi  -  QnQ2^Qi2^ 

P=Pi2P2-'P72, 

Q  —  Q12Q2  ^Qi2» 


(2.39) 

(2.40) 

(2.41) 

(2.42) 

(2.43) 

(2.44) 


respectively. 

Theorem  2.1  shows  that  one  can  compute  an  optimal  reduced-order  controller  by  solving  the  set 
of  coupled,  modified  Riccati  and  Lyapunov  equations  (2.31)-(2.34)  subject  to  the  rank  condition 
constraints  (2.35).  One  approach  to  find  a  solution  of  (2.31)-(2.34)  is  based  on  homotopy  methods. 


3.  Homotopy  Methods  for  the  Solution  of  Nonlinear  Algebraic  Equations 

A  “homotopy”  is  a  continuous  deformation  of  one  function  into  another.  Over  the  past  several 
years,  homotopy  or  continuation  methods  (whose  mathematical  basis  is  algebraic  topology  and 
differential  topology^®)  have  received  significant  attention  in  the  mathematics  literature  and  have 
been  applied  successfully  to  several  important  problems^®"^®.  Recently,  the  engineering  literature 
has  also  begun  to  recognize  the  utility  of  these  methods  for  engineering  applications^®""*^ .  The 
purpose  of  this  section  is  to  provide  a  very  brief  description  of  homotopy  methods  for  finding  the 
solutions  of  nonlinear  algebraic  equations.  The  reader  is  referred  to  Ref.  35,  36  and  46  for  additional 
details. 
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The  basic  problem  is  as  foDows.  Given  sets  U  and  V  contained  in  R"  and  a  mapping  F\U  V, 
find  solutions  u  €  U  to  satisfy 

F(u)  =  0.  (3.1) 

Homotopy  methods  embed  the  problem  (3.1)  in  a  larger  problem.  In  particular  let  H:U  x  [0, 1]  -*• 

R"  be  such  that: 

1)  H{u,l)=F{u). 

2)  There  exists  at  least  one  known  uo  €  R"  which  is  a  solution  to  =  0,  i.e., 

^(uo,0)  =  0.  (3.2) 

3)  There  exists  a  continuous  curve  (u(A),  A)  in  R"  x  [0, 1]  such  that 

^(u(A),A)  =  0  for  A  e  [0,1],  (3.3) 

with 

(u(0),0)=(uo,0).  (3.4) 

4)  The  curve  (u(A),  A)  is  differentiable. 

A  homotopy  algorithm  then  constructs  a  procedure  to  compute  the  actual  curve  such  that  the 
initial  solution  u(0)  is  transformed  to  a  desired  solution  u(l)  satisfying 

0  =  i7(u(l),l)=F(u(l)).  (3.5) 


Now,  differentiating  H{u{X),X)  =  0  with  respect  to  A  yields  Davidenko’s  differential  equation 


dH  du  dH 
Ti^dX  ^  9A  “ 


(3.6) 


which  together  with  ti(0)  =  uq,  defines  an  initial  value  problem.  The  desired  solution  u(l)  is  then 
obtained  by  numerical  integration  from  0  to  1.  Some  numerical  integration  schemes  are  described 
in  Ref.  35  and  46. 
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4,  A  Homotopy  Algorithm  for  H2  Optimal  Reduced-Order  Control 

This  section  begins  by  introducing  a  homotopy  map  based  on  the  optimal  projection  equations. 
The  construction  of  the  initial  point  is  then  discussed  in  detail.  Finally,  the  actual  homotopy 
algorithm  is  presented. 

4.1  The  Homotopy  Map 


To  define  the  homotopy  map  we  assume  that  the  plant  matrices  {A,  B,  C,  D),  the  cost  weighting 
matrices  {Ri,R2),  the  disturbance  matrices  (Vi,  V2)  are  functions  of  the  homotopy  parameter  A  € 
[0, 1].  In  particular,  the  following  is  assumed: 


4(A)  B{X)  _  Ao  Bo  ,  \(  Bf  _  Ao  Bo  \ 
C(A)  T>(A)J  “  [Co  OoJ  V[0  ^/J  [<^o  Do\) 


(4.1) 


Rli^)  —  Rlfi  +  ^{RlJ  ~  -Rl.o))  ■R2(A)  =  R2fi  +  '^(■^2,/  ~  -^2,0)5  (4-2) 

Vi(A)  =  Vi,o  +  A(Vi  j  -  Vi_o),  V2(A)  =  V2,o  +  A(V2j  —  V2,o).  (4.3) 

Note  that  the  above  equations  imply  that  4(0)  =  4o,  B{0)  =  Bq,  V2(0)  =  V2,o,  and  that 


4(1)  =  4/,  5(1)  =  Bf,  ...,  V2(l)  =  V2J.  For  notational  simplification,  we  also  define 

E(A)  =  5(A)ii2-^(A)5'^(A),  E(A)  i  C’^(A)V2-^(A)C(A).  (4.4) 

The  homotopy  formulation  0  =  H{{P,Q,P,Q),X)  is  thus  given  by 

0  =  4(A)Tp(A)  +  P(A)4(A)  +  Pi(A)  +  rT(A)P(A)E(A)P(A)T(A) 

-  r'^(A)P(A)E(A)P(A)  -  P(A)E(A)P(A)r(A),  (4.5) 

0  =  4(A)Q(A)  +  Q(A)4(A)T  +  Vi(A)  +  r(A)Q(A)E(A)g(A)rT(A) 

-  r(A)g(A)E(A)g(A)  -  g(A)E(A)g(A)rT(A),  (4.6) 

0  =  (4(A)  -  g(A)E(A))Tp(A)  +  P(A)(4(A)  -  g(A)E(A))  -  rT(A)P(A)E(A)P(A)r(A) 

+  r'^(A)P(A)E(A)P(A)  +  P(A)E(A)P(A)r(A),  (4.7) 

0  =  (4(A)  -  E(A)P(A))g(A)  +  g(A)(4(A)  -  E(A)P(A))T  -  r(A)g(A)E(A)g(A)rT(A) 

+  r(A)g(A)E(A)g(A)  +  g(A)E(A)g(A)rT(A),  (4.8) 

where 

rank  g(A)  =  rank  P(A)  =  rank  g(A)P(A)  =  Uc,  (4.9) 
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r(A)  =  0(A)P(A)[Q(A)P(A)]#, 


(4.10) 


and  A  €  [0, 1]. 

4.2,  Initial  System  Selection 

Before  describing  the  general  logic  and  features  of  the  homotopy  algorithm  for  H2  optimal 
reduced-order  dynamic  compensation,  we  first  discuss  the  importance  of  the  homotopy  initializa¬ 
tion  and  some  guidelines  for  choosing  the  initial  system  matrices.  It  is  assumed  that  the  designer 
has  supplied  a  set  of  system  and  weighting  matrices,  5/  =  (A/, 

describing  the  optimization  problem  whose  solution  is  desired.  In  addition,  it  is  assumed  that  the  de¬ 
signer  has  chosen  an  initial  set  of  related  system  matrices  So  =  {Aq-,  Bq.Co^  Ri^oy  R2,o^  1^2,0) 

that  has  an  easily  obtained  (Pq.Qo^  Po,  Qo)  which  is  either  a  solution  or  a  good  approximation  to  the 
solution  of  the  optimal  projection  equations  corresponding  to  the  initial  system  (i.e.,  (4.5)-(4.10) 
with  A  =  0). 

While  in  general  homotopy  methods  ease  the  restriction  that  the  starting  point  be  close  to 
some  optimal  of  the  optimization  problem,  the  initial  guess  does  affect  the  performance  of  the 
homotopy  algorithm.  For  example,  it  is  always  possible  to  choose  the  initial  system  So  such  that 
(i4o,  Pq,  Co,  Po)  is  nonminimal  with  minimal  dimension  ric-  In  this  case,  it  is  easy  to  show  that  the 
corresponding  LQG  compensator  has  minimal  dimension  <  Uc  and  will  usually  have  minimal 
dimension  =  ric.  In  the  latter  case,  (Ac,o,  Pc,o,  Cc,o)  is  chosen  as  a  minimal  realization  of  the 
LQG  compensator.  However,  we  have  seen  experimentaUy  that  the  corresponding  homotopy  can 
lead  to  failure  of  the  homotopy  algorithm.  Similar  observations  have  been  made  in  Ref.  13.  In 
particular,  Ref.  13  shows  that  allowing  the  plant  parameters  to  vary  along  the  homotopy  path  can 
lead  to  the  development  of  destabilizing  controllers  or  path  bifurcations. 

The  reason  that  the  above  type  of  homotopy  would  cause  problems  is  somewhat  intuitive 
since  for  a  given  A,  say  Ai  6  [0,1],  a  controller  (Ac(Ai),  5c(Ai),  Cc(Ai))  that  stabilizes  the  plant 
(A(Ai),  jB(Ai),  C(Ai),  Z?(Ai))  may  not  stabilize  the  plant  (A(A2),  5(A2),  C(A2),  i5(A2))  for  A2  ^  Ai. 
Hence,  below  we  present  ways  of  constructing  the  initial  system  Sq  that  does  not  require  the  plant 
parameters  (A,  D)  to  vary  along  the  homotopy  path.  In  this  case,  a  controller  that  stabilizes 
the  plant  at  Aj  will  also  stabilize  the  plant  at  A2  >  Ai.  This  argument  in  itself  does  not  ensure 
that  at  every  step  along  the  homotopy  algorithm  the  controller  design  remains  stabilizing.  This 
is  a  subject  that  requires  further  research.  It  should  be  mentioned  that  another  advantage  of  a 
homotopy  that  varies  only  the  performance  weights  (Ri,  ^2^  1^2)  is  that  the  optimal  controller 
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at  each  point  is  optimal  with  respect  to  the  real  nominal  plant  (Aj,Bf,Cf,Df). 

Now,  we  present  two  options  for  constructing  Sq  as  proposed  in  Ref.  15. 

Option  1.  One  alternative  is  to  choose  Aq  to  be  stable  (e.g.,  if  A/  is  stable,  let  Ao  =  Aj  or 
if  Af  is  unstable,  \e\.  Ao  =  Aj  -  al  where  a  is  sufficiently  large  to  ensure  stability  of  Ao)  and,  as 
elaborated  in  Ref.  47  to  choose  either  (Ri,0)  1^2, o)  or  (^i,o>  -^2,0)  where  Ri,o  ^  0,  ^2,0  >  0, 

and  V2,o  >  0,  as  given  below.  (All  other  initial  parameters  are  equal  to  their  final  values.) 

( i)  In  a  basis  in  which 

Ao  = 

choose  R],o  to  be  of  the  form 

Ri.0=  0  ,  (/?i.o)ii  (4.12) 

and  for  some  positive  scalar  a  choose 

^2,0  =  aV2j.  (4.13) 

(n)  In  a  basis  in  which 

Ao=  ,  (Ao)ii  (4.14) 

choose  Vi^o  to  be  of  the  form 

Vi.o=  0  ,  (V^i,o)n  (4.15) 

and  for  some  positive  scalar  a  choose 

^2,0  =  ocR2J-  (4-16) 

As  discussed  in  Ref.  47,  a  appearing  in  (4.13)  and  (4.16)  can  always  be  chosen  sufficiently  large 
so  that  the  corresponding  LQG  compensator  is  nearly  nonminimal.  In  this  case,  (Ac,0)-Rc,0)C'c,o) 
is  easily  obtained  by  reducing  the  LQG  compensator  to  its  (nearly)  minimal  realization  using  an 
appropriate  technique  such  as  balanced  controller  reduction"*®.  Next,  form  the  closed-loop  system 
consisting  of  {Ao,  Bo,  Co,  Do)  and  {Acfi,  Bcfi,Cc,o)  and  compute  the  initial  guess  Po,Qo,Po,  and 
Qo  using  (2.41)-(2.44),  respectively.  Since  (Ac,o,  -Bc.Oi  C'c.o)  is  a  close  approximation  to  the  minimal 
realization  of  the  corresponding  nearly  nonminimal  LQG  compensator,  {Po,Qo,  Po,Qo)  is  a  good 


(>4o)ii 

(>Io)2i 


0 

(■^0)22 
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approximation  of  the  solution  of  the  optimal  projection  equations  corresponding  to  the  initial 
system  (i.e.,  (4.5)-(4.10)  with  A  =  0). 

Option  2.  A  second  alternative  (which  does  not  require  Aq  to  be  stable)  is  based  on  the  following 
experimental  observation.  The  initial  system  can  be  chosen  to  correspond  to  a  low  authority  control 
problem,  e.g.,  one  can  choose 

■^2,0  =  0-^2,/)  1^2,0  =  ^^2,/> 

with  a  and  /9  large  and  let  all  other  initial  system  parameters  equal  their  final  values.  In  this 
case  it  has  been  observed  that  the  reduced-order  controller  (Ac^r,  Bc,r,Cc,r)  obtained  by  sub- 
optimal  reduction  of  an  LQG  controller  will  often  yield  virtually  the  same  cost  as  the  LQG 
controller'’®,  hence  indicating  that  (A^.r,  5c,r, Cc,r)  may  be  nearly  optimal.  In  this  case,  we  choose 
(Ac,0)  5c,0)  Gc.o)  =  iAc,ri  Bc,r,Cc,r)-  (It  should  be  noted  that  these  observations  are  partially  ex¬ 
plained  by  the  results  in  Ref.  47.)  Then,  foUow  the  same  procedure  described  in  option  1  to  form 
the  closed-loop  system  and  compute  the  initial  guess  {PoiQoi  PotQo)- 


4.3.  The  Derivative  and  Correction  Equations 

The  homotopy  presented  next  uses  a  predictor/corrector  numerical  integration  scheme.  The 
prediction  step  requires  derivatives  (.P(A),(p(A),P(A),Q(A)),  where  M  =  while  the  correction 
step  is  based  on  using  a  Newton  correction,  denoted  as  ( AP,  AQ,  AP,  AQ).  Before  constructing  the 
derivative  and  correction  equations,  we  state  the  following  useful  properties  about  the  derivatives 
of  the  contragredient  transformation  of  {Q,P). 

Using  Lemma  2.1,  equations  (4.9)  and  (4.10)  imply 


and 


where 


Q{X)  =  VU(A)A(A)1U'^(A)  =  IUi(A)n(A)luT(A), 
P(A)  =  U'^iX)A{X)U{X)  =  f/i(A)n(A)C/TfA), 


r(A)  =  W{X) 


K  0 
0  0 


[/(A)  =  IUi(A)t/T(A), 


1U(A)=  [lyi(A)  1U2(A)],  U/i(A)  e  VU2(A)  G 

t/(A)  =  VU-’(A), 


f/(A)  i 


(4.17) 

(4.18) 

(4.19) 

(4.20) 

(4.21) 

(4.22) 
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or,  equivalently, 


f/(A)iy(A)  = /„,  (4.23) 

m=  0  ,  Q(A)eR”'""%  (4.24) 

and  fi(A)  is  diagonal  and  positive-definite.  For  notational  simplicity,  we  omit  the  argument  A  in 
the  subsequent  equations. 

The  derivative  equations,  obtained  by  differentiating  (4.5)“(4.8)  with  respect  to  A,  are  given 
by 

0  =  ApP  +  P  Ap  +  Rp{P  P  yQ)  +  Rp{P  yQy  PyQ)  +  Fp  +  Vp  +  Ri ,  (4.25) 

0  =  AqQ  +  QAJ^  +  Rq{P  ^Q^P^Q)  +  R^{P  yQyPyQ)'\‘yQ^  Vq  +  Vi ,  (4.26) 

Q  =  AlP^  Pa^  +  Rp{P,Q,P,ti)  +  Rl{P,Q,P,^)  +  Vp  +  Vj,  (4.27) 

0  =  +  ^Al  +  R^{P,  Q,  P,  i)  +  RliP,  Q,  P,  ^)  +  VQ  +  Vy.  (4.28) 

The  correction  equations,  derived  similarly  by  using  the  relationship  between  the  Newton’s 


method  and  a  particular  error  homotopy,  are  given  by 

0  =  A]>AP  +  APAp  +  Rp(AP,  AQ,  AP,  AQ)  +  R]>{AP,  AQ,  AP,  AQ)  +  Ep,  (4.29) 

0  =  AqAQ  +  AQAI  +  Rq{AP,AQ,aP,AQ)  +  RI{AP,AQ,aP,AQ)  +  Eq,  (4.30) 

0  =  AP  +  APA^  +  Rp{AP,  AQ,  AP,  AQ)  +  Pj(  AP,  AQ,  AP,  AQ)  +  Ep,  (4.31) 

0  =  A„  AQ  +  AQ  Aj  +  Rq{AP,  AQ,  AP,  AQ)  +  Pj(AP,  AQ,  AP,  AQ)  +  (4.32) 


The  detail  derivation  of  (4.25)-(4.32)  and  the  definitions  of  all  the  coefficients  are  described 
in  the  Appendix  A.  Comparing  (4.29)-(4.32)  with  (4.25)-(4.28)  reveals  that  the  derivative  and 
correction  equations  are  identical  in  form.  Thus,  only  one  solution  procedure  would  be  required  to 
solve  both  sets  of  equations.  Each  set  of  equations  consist  of  four  coupled  Lyapunov  equations.  Since 
these  equations  are  linear,  using  Kronecker  algebra®^  they  can  be  converted  to  the  vector  form  Ax  = 
h  where  for  (4.29)-(4.32)  x  is  a  vector  containing  the  independent  elements  of  AP,  AQ,  AVt^i,  At/j, 
and  Afi.  A  is  then  a  square  matrix  of  dimension  n(n  +  1)  +  (2nnc  +  n\).  Inversion  of  A  is  hence 
very  computationally  intensive  for  even  relatively  small  problems  (e.g.,  n  =  20,  =  10). 

Fortunately,  the  coupling  terms  Rap,  Raq,  and  R^q  which  are  linear  functions  of  (AP, 
AQ,AP.  AQ)  or,  equivalently,  (AP,  AQ,  AIVi,  Af/i,  Afl)  in  (4.29)-(4.32),  have  relatively  low 
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ranks.  Hence,  the  technique  of  Ref.  21,  which  exploits  this  low  rank  property,  can  be  used  to 
efficiently  sohe  equations  (4.29)-(4.32)  (or,  equivalently,  (4.25)-(4.28)).  In  particular,  this  solution 
procedure  requires  inversion  of  a  square  matrix  of  dimension  (2n  +  nc)(m  +  /)  +  i  and  to  solve  four 
sets  of  (2n  +  nc){m  + 1)  standard  n  x  n  Lyapunov  equations,  which  has  much  less  computational 
burden  than  the  approach  using  Kronecker  algebra  as  described  in  the  previous  paragraph.  In 
comparison,  the  dimension  of  the  homotopy  Jacobian  inverted  in  the  minimal  parameterization 
approach  is  ndm  +  1)  which  is  smaller  than  the  characteristic  dimension  associated  with  this  ap¬ 
proach.  However,  the  algorithms  based  on  these  minimal  parameterization  basis  sometimes  exhibit 
numerical  ill-conditioning  or  can  even  fail  due  to  the  basis  constraint.  The  details  of  the  solution 
procedure  are  described  in  Appendix  B. 

Also,  note  that  if  the  homotopy  path  exists,  the  solution  to  the  coupled  Lyapunov  equations 
will  be  well-posed.  Hence,  the  matrices  Ap,Aq,Au,  and  A^  in  (4.25)-(4.32)  will  have  the  property 
that  any  two  eigenvalues  of  a  given  matrix  will  not  sum  to  zero. 

4.4  Overview  of  the  Homotopy  Algorithm 

Below,  we  present  an  outline  of  the  homotopy  algorithm.  This  algorithm  describes  a  pre¬ 
dictor/corrector  numerical  integration  scheme.  In  order  to  force  the  rank  conditions  (4.9)  of  Q 
and  P  during  intermediate  steps,  we  use  the  following  scheme  to  update  {P,Q,P,Q)  along  the 
homotopy  path.  First,  using  (A.29)-(A.31)  and  (A.57)-(A.59)  and  the  algorithms  described  in 
Appendix  C,  the  prediction  {Q,P)  and  correction  {AQ,AP)  are  first  converted  to  (M^i,^i,fi)  and 
(AVFi,  At/i,  Afi),  respectively.  Note  that  17  and  Ail  are  forced  to  be  Uc  x  nc  diagonal  matrices 
with  this  formulation.  Next,  we  update  {P,Q,Wi,U\,il)  with  these  predictions/corrections.  Fi¬ 
nally,  new  {Q,P)  are  constructed  with  updated  (kTi,C/i,n)  using  (4.17)  and  (4.18)  and  the  rank 
conditions  (4.9)  are  maintained. 

There  are  several  options  to  be  chosen  initially.  These  options  are  enumerated  before  presenting 
the  actual  algorithm.  Note  that  each  option  corresponds  to  a  particular  fiag  being  assigned  some 
integer  value. 

4.4.1  Prediction  Scheme  Options 

Here  we  use  the  notation  Aq,  A_i,  and  Aj  representing  the  values  of  A  at  respectively  the  current 
point  on  the  homotopy  curve,  the  previous  point,  and  the  next  point.  Also,  M  =  dM/dX  and  ^(A) 
is  a  vector  representation  of  (P(A),Q(A),VF'i(A),f/i(A),f7(A)). 
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pred  =  0.  No  prediction.  This  option  assumes  that  0{Xi)  =  ^(Aq). 


pred  =  1.  Linear  prediction.  This  option  assumes  that  ^(Ai)  is  predicted  using  ^(Aq)  and 
0(Ao).  In  particular, 

^(Ai)  =  ^(Ao)  +  (Aj  -  Ao)0(Ao),  (4.33) 

pred  =  2.  Cubic  spline  prediction.  This  prediction  of  0(Ai)  requires  ^(Ao),^(Ao),0(A_i),  and 
^(A_i).  In  particular, 

vec[0(Ai)]  =  flo  +  c^iAi  +  n2Ai  +  flaAj, 
where  ao,ai,a2,  and  are  computed  by  solving 

[oo  Gl  (i2  ^3] 


-  1 

0 

1 

0  ■ 

-vec[e(A_i)]- 

A_i 

1 

Ao 

1 

vec[0(A_i)j 

Ail 

2A 

Ag 

2Ao 

vec[0(Ao)] 

LAii 

3Aii 

Aq 

3Aq  . 

.  vec[0(Ao)]  . 

Note  that  if  0(A-i)  and  ^(A-.i)  are  not  available  (as  occurs  at  the  initial  iteration  of  the 
homotopy  algorithm),  then  ^(Ai)  is  predicted  using  the  linear  prediction  given  by  (4.33). 

4.4.2.  Basis  Options  for  Solving  the  Coupled  Lyapunov  Equations 

The  main  computational  burden  of  the  algorithm  given  below  is  the  solution  of  the  four  coupled 
modified  Lyapunov  equations  (4.25)-(4.28)  or  (4.29)-(4.32)  at  each  prediction  step  or  correction 
iteration.  Efficient  solutions  of  these  equations,  as  described  in  Appendix  B,  makes  the  algorithm 
feasible  for  large  scale  systems.  The  most  desired  solution  procedure  is  based  on  diagonalizing 
the  coefficient  matrices  and  of  the  coupled  Lyapunov  equations.  This  is  usually 

possible.  However,  it  is  also  possible  that  this  diagonalization  wiD  be  intractable  for  some  points 
along  the  homotopy  path.  A  numerical  conditioning  test  is  embedded  in  the  program  to  determine 
whether  the  coefficient  matrices  are  truly  diagonalizable.  If  they  are  not,  then  the  coupled  Lyapunov 
equations  are  solved  using  the  Schur  decomposition.  A  second  option  relies  exclusively  on  the  Schur 
decomposition. 

basis  =  1.  Ap,  Aq,  and  are  diagonalized  when  solving  (4.25)-(4.28)  or  (4.29)~(4.32). 

basis  =  2.  Ap,  Ag,  A^.  and  A^  are  in  Schur  form  when  solving  (4.25)-(4.28)  or  (4.29)-(4.32). 

4.4.3.  Outline  of  the  Homotopy  Algorithm 

Step  1.  Initialize  /oop  =  0,  A  :=  0,  AA  G  (0, 1],  5  =  5o,  {P,Q,  P,Q)  =  {Po.Qo.  Po.Qo)^ 
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Step  2.  Let  loop  =  loop  +  1.  If  loop  =  1,  then  go  to  Step  4. 


Step  3.  Advance  the  homotopy  parameter  A  and  predict  the  corresponding  P(A),  Q(A),  P(A),  and 
Q{X)  as  follows. 

3a.  Let  Aq  —  A. 

3b.  Let  A  =  Aq  +  AA. 

3c.  If  pred  >  1,  then  perform  the  next  step  to  compute  P{Xo),Q(Xo)i  P{Xo),  and  Q(Ao)  ac¬ 
cording  to  (4.25)-(4.28).  Else,  let  P{X)  =  P(Xo),Q(X)  =  Q(Xo),  P(X)  =  P(Xo),  and 
Q(X)  =  Q(Xo)  and  go  to  step  (4),  i.e.,  no  prediction  is  performed. 

3d.  Transform  Ap,Aq,Aw,  and  A^  into  suitable  matrix  form  according  to  the  option  defined 
by  basis,  then  solve  (4.25)-(4.28)  as  described  in  Appendix  B. 

3e.  Compute  (I^i(Ao),  Ui{Xo),  I^(Ao))  from  ((?(Ao),  P{Xo))  by  using  (A.29)-(A.31)  and  the  pro¬ 
cedure  described  in  Appendix  C. 

3f.  Predict  {P{X),Q{X),Wi{X),Ui{X),^{X))  by  using  the  option  defined  by  pred. 

3g.  Compute  {Q{X),P{X))  from  (VPi(A),  t/i(A),  fi(A))  using  (4.17)  and  (4.18). 

Step  4.  Correct  the  current  approximations  P(A*),  Q(A*),  P(A*),  and  Q(A*)  as  foOows. 

4a.  Compute  the  errors  {Ep,  Eq,  E^,  E'p)  in  the  correction  equations  (A.38)-(A.41). 

4b.  Transform  Ap,  Aq,  A^,  and  Au  into  suitable  matrix  form  by  using  the  option  defined  by 
basis,  then  solve  (4.29)-(4.32)  as  described  in  the  Appendix  B  for  AP,AQ,AP,  and  AQ. 

4c.  Compute  (Al^i,  Af/i,  AQ),  from  {AQ,AP)  by  using  (A.57)-(A.59)  and  the  algorithms 
described  in  Appendix  C. 

4d.  Let 

P{X)^  P{X)  +  AP,  Q{X)^Q{X)  +  AQ, 

VPi(A)  ^  M'i(A)-f  AVPi,  Ui{X)^  Ui{X)  +  AUi,  Q(A)  ^  Q(A)  +  AQ. 

4e.  Compute  (<5(A),  P{X))  from  (IPi(A),  Ui{X),  Q(A))  using  (4.17)  and  (4.18). 

4f.  Recompute  the  errors  {Ep,  Eq,  Ep,  E'^)  in  the  correction  equations  (A.38)-(A.41).  If  the 
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mQY  A  _  11^^ Ha  ^  where  b*  is  some  Dresissiffned  correction 

V|1Hi(A)||a’  IIV^AXIa’  ||2:(A)||a  ’  l|i^(>)llA  ^  ^  ^  preassignea  corretuun 

tolerance,  then  set  Aq  =  A,  and  adjust  next  step  size  AA  according  to  the  number  of 
the  correction  steps  required  to  converge  before  going  to  Step  3b.  Else,  if  the  number  of 
corrections  exceeds  a  preset  limit,  reduce  AA  and  go  to  Step  3b;  otherwise,  go  to  Step  4b. 


Step  5.  If  A  =  1,  then  stop.  Else,  go  to  Step  2. 

Note  that  the  algorithm  described  above  allows  the  step  size  (AA)  to  vary  dynamically  de¬ 
pending  on  the  speed  of  convergence  which  is  gauged  by  the  number  of  the  correction  steps.  If 
the  number  is  small  (e.g.,  <  3),  we  increase  (e.g.,  double)  the  previous  step  size  when  computing 
the  next  step.  If  it  takes  many  steps  to  converge  (e.g.,  >  10),  or  does  not  converge,  the  step  size 
is  reduced  (e.g.,  in  half).  6'  in  Step  4f  is  a  preassigned  correction  error  tolerance  which  can  be 
assigned  with  two  values  in  the  program.  One  is  the  intermediate  correction  error  tolerance  which 
is  used  when  A  <  1.  The  other  value  is  the  final  correction  error  tolerance  which  is  usually  smaller 
and  is  used  when  A  =  1.  The  choice  of  the  magnitudes  of  theses  tolerances  are  problem  dependent. 
In  general,  the  intermediate  correction  tolerance  is  desired  to  be  reasonably  large  to  speed  the 
homotopy  curve  following.  However,  the  algorithm  may  fail  to  converge  if  these  tolerances  are  too 
large.  The  final  correction  tolerance  is  usually  small  to  ensure  the  accuracy  of  the  final  results. 


5.  Illustrative  Numerical  Examples 

In  this  section  we  present  two  illustrative  numerical  examples  that  demonstrate  the  effectiveness 
of  the  proposed  algorithm.  For  both  examples,  the  MATLAB  implementation  of  the  homotopy 
algorithm  to  design  the  optimal  reduced-order  compensator  was  run  on  a  486,  33  MHz  PC.  The 
design  parameters  i?2  ^2  were  allowed  to  vary  during  the  homotopy  path. 

First,  we  consider  a  control  design  for  an  axial  beam  with  four  disks  attached  as  shown  in 
Figure  5.1.  This  example  was  derived  from  a  laboratory  experiment and  has  been  considered  in 
several  subsequent  publications"^^’^^”^^ .  The  basic  control  objective  for  the  four-disk  problem  is  to 
control  the  angular  displacement  at  the  location  of  disk  1  using  a  torque  input  at  the  location  of 
disk  3.  It  is  also  assumed  that  a  torque  disturbance  enters  the  system  at  the  location  of  disk  3. 

The  design  philosophy  adopted  here  is  that  the  scaling  92  of  the  nominal  control  weight  i22,o  =  1 
and  the  nominal  sensor  noise  intensity  V2,o  =  1  sire  simply  ‘‘design  knobs”  used  to  determine  the 
control  authority.  (Hence.  R2{^)  =  92(A)i?2,o  sind  V2('^)  =  92(A)V2,o-)  Here,  we  consider  the  design 
of  2”^^,  4*^,  and  6^^  -order  controllers  for  various  authority  levels. 
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Since  at  92  =  10,  the  and  6^^  reduced-order  controllers  by  balancing  are  all  good  ap¬ 

proximations  of  the  corresponding  optimal  controller,  respectively,  we  use  this  suboptimal  controUer 
to  initialize  the  homotopy  algorithm  and  deform  this  controller  into  the  higher  authority  optimal 
controller  corresponding  to  92  =  1*  In  each  of  the  following  passes,  we  increase  the  authority  level 
by  decreasing  R2  and  V2  by  a  factor  of  10,  i.e.,  92/  =  O.l92,o»  2ind  at  the  end  of  each  pass  deform  the 
initial  optimal  controller  to  the  optimal  controller  corresponding  to  the  higher  authority  level.  This 
process  is  repeated  for  every  reduced-order  design.  Figures  5.2-5.4  compare  the  optimal  curves  at 
various  authority  levels  for  an  LQG  controller,  a  reduced-order  controller  obtained  by  balancing  and 
an  optimal  reduced-  order  controUer.  In  each  case,  the  optimal  reduced-order  controUer  performs 
better  than  the  balanced  controUer  as  the  authority  is  increased.  Figure  5.5  compares  the  optimal 
controUers  of  various  orders.  This  type  of  figure  can  be  used  in  practice  to  determine  the  order  of 
the  controUer  to  be  implemented. 


Control  Authority 

RealTime 

Predictions 

92(1) 

MegaFLOPs 

(sec.) 

&Corrections 

10-1 

412 

672 

35 

407 

727 

35 

HHHBEBIIHHI 

393 

723 

34 

274 

478 

24 

10“^ 

♦ 

2990 

120 

Table  5.1.  Run-Time  statistics  of  Four  Disk  Example  for  =  4 


Table  5.1  shows  some  of  the  run  time  statistics  for  solving  the  4^^-order  optimal  compensator 
for  this  example  at  various  control  authorities.  The  cubic  spUne  prediction  option  and  the  diagonal 
basis  option  were  chosen  for  solving  the  coupled  Lyapunov  equations  in  this  comparison.  However, 
for  92(1)  =  10”^  case,  diagonaUzing  errors  are  significant  and  the  basis  option  was  switched  to  the 
Schur  form. 

The  Frobenius  norms  of  P,  Q,  P,  and  Q  are  also  recorded  along  the  homotopy  path  and  a  typical 
results  are  shown  in  Figures  5. 6-5. 9  for  the  4^^-order  controUer  design.  It  is  interesting  to  note  that 
as  the  control  authority  is  increased  beyond  a  certain  level  (e.g.,  for  =  4,92  <  lO”’^)  those  values 
approach  some  stable  Umit  a^  indicated  in  the  figures.  This  is  because  P,  Q,P,  and  Q  converge  to 
fixed  values  as  the  control  authority  increases.  It  foUows  that  the  optimal  reduced-order  controUer 
converges  to  a  fixed  value.  This  later  phenomenon  has  been  observed  previously^^ .  Furthermore, 
most  of  the  prediction/correction  steps  indicated  in  Table  5.1  for  this  special  case  (92(1)  =  10~^) 
occur  when  A  is  approaching  1  and  P, (5,P,  and  Q  approach  their  final  fixed  values. 
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Algorithm  efficiency  as  a  function  of  the  prediction  options  and  basis  options  for  solving  the 
coupled  Lyapunov  equations  has  been  studied  in  the  context  of  a  similar  algorithm  for  H2  op- 
timal  model  reduction  using  the  corresponding  optimal  projection  equations^"*.  It  was  seen  that 
the  algorithm  is  most  efficient  when  using  the  cubic  spline  prediction  and  diagonalizing  the  coeffi¬ 
cient  matrices  of  the  coupled  Lyapunov  equations.  These  conclusions  also  hold  for  the  algorithm 
presented  here. 

The  second  example  illustrates  the  design  of  an  optimal  reduced-order  controller  for  a  17^^ 
order  model  of  one  of  the  single-input,  single-output  (SISO)  transfer  functions  of  the  Active  Control 
Technique  Evaluation  for  Spacecraft  (ACES)  structure  at  NASA  Marshall  Space  Flight  Center 
The  actuator  and  sensor  are  respectively  a  torque  actuator  and  a  collocated  rate  gyro.  The  model 
includes  the  actuator  and  sensor  dynamics.  A  first  order  all-pass  filter  was  appended  to  the  model 
to  approximate  the  computational  delay  associated  with  digital  implementation. 

Following  the  same  approach,  we  design  an  8^^-order  controller  for  this  plant.  Figure  5.10 
shows  the  performance  curves  for  authority  levels  corresponding  to  q2  €  (10”^,  10“^, . . . ,  10“^) 
and  compare  the  optimal  curves  for  an  LQG  controller,  and  an  optimal  reduced-  order  controller. 
For  this  special  case,  suboptimal  reduced-  order  controllers  obtained  by  balancing  destabilize  the 
closed-loop  system  when  ?2  ^  10“^. 

Table  5.2  shows  some  of  the  run  time  statistics  for  solving  the  8^^-order  optimal  compensator 
for  this  example  at  various  control  authorities.  The  cubic  spline  prediction  option  and  the  diagonal 
basis  option  were  chosen  for  solving  the  coupled  Lyapunov  equations  in  this  comparison.  The 
under  the  MegaFLOPs  heading  indicates  that  the  MATLAB  FLOP  counter  overflowed  and  so  the 
FLOP  data  is  unavailable. 


Control  Authority 

RealTime 

Predictions 

92(1) 

MegaFLOPs 

(sec.) 

&  Corrections 

10-* 

* 

4098 

19 

♦ 

9008 

42 

HHHQBHHHi 

* 

4712 

22 

10-' 

* 

2216 

10 

Table  5.2.  Run-Time  statistics  of  ACES  Structure  Example  for  ric  =  8 


6.  Conclusions 

Gradient-based  minimal  parameterization  homotopy  algorithms  for  Ho  optimal  reduced-order 
dynamic  compensation^^  are  computationally  efficient  in  theory,  but  tend  to  experience  numerical 
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ill-conditioning  in  practice  due  to  the  constraint  on  the  controller  basis.  Hence,  this  paper  has  pre¬ 
sented  a  new  homotopy  algorithm  for  the  synthesis  of  II2  optimal  reduced-order  compensators  based 
on  directly  solving  the  optimal  projection  equations  which  characterize  the  optimal  compensator. 
The  resulting  algorithm  is  usually  more  numerically  robust  than  the  gradient-based  homotopy  al¬ 
gorithms.  However,  the  number  of  variables  associated  with  this  approach  is  (2n  +  ric)  *  {m  +  1) 
which  is  greater  than  the  number  of  variables  associated  with  minimal  parameterization  approach 
{nc{m  +  l)).  The  two  examples  of  the  previous  section  demonstrate  the  effectiveness  of  the  proposed 
algorithm. 

Appendix  A.  Formulation  of  the  Derivative  and  Correction  Equations 

Before  deriving  the  derivative  and  correction  equations  (4.25)-(4.32),  we  state  the  following 
useful  properties  about  the  derivatives  of  the  contragredient  transformation  of  (Q,P). 

Note  that  it  follows  from  (4.17)-(4.19)  that  r(A)  can  be  expressed  as 


r(A)  =  Q(A)t/T(A)A+(A)C/(A)  =  Q{X)Ui{X)n-\X)U^{X),  (A.l) 

or 

r(A)  =  fT(A)A^(A)VF'^(A)P(A)  =  WiiX)n-\X)W^{X)P{X),  (A.2) 


where 


At(A)  = 


■fi-^(A) 

0 


0 

0 


(A.3) 


The  representations  of  r(A)  given  by  (A.l)  and  (A.2)  are  used  below  as  a  convenient  way  of  ex¬ 
pressing  the  derivative  equations  partially  in  terms  of  Q{X)  and  P(A)  as  opposed  to  expressing  the 
derivative  equations  only  in  terms  of  VFi(A),  Pi(A),  and  fl(A).  For  notational  simplicity,  we  omit 
the  argument  A  in  the  subsequent  equations. 


Differentiating  (A.l)  or  (A.2),  gives  the  following  expressions  for  r 


T  =  +  Q{Uia-^U^  +  (A.4) 

or 

i  =  \v\n-'^w^P  +  +  WiU-'^w^)P,  (a.5) 

with 

= -[D-M-D  = (A.6) 

dX 
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since  Cl  is  diagonal.  Below,  we  derive  the  matrix  equations  that  can  be  used  to  solve  for  the 
derivatives  and  corrections. 


A.l.  The  Derivative  Equations 

Differentiating  (4.5)-(4.8)  with  respect  to  A  and  using  (A.4)-(A.6),  yields 

0  =  AlP  +  PAp  +  Q,  >,  Q)  +  RliP,  Q,  >,  ^)  +  Vp  +  V^  +  Ru  ( A.7) 

0  =  AqQ  +  QAl  +  Rq{P,Q,P,^)  +  Rl{P,Q,Ki)  +  Vq  +  V^  +  Vu  (A.8) 

0=AlP  +  Pa^  +  Rp(P,  Q,  P,  0)  +  RjiP,  Q,  P.  +  (A.9) 

0  =  +  CiAl  +  Rq{P,Q,P,0)  +  Rl{P,Q,P,d)  +  +  VT,  (A.IO) 

where 

Ap^A-LPt,  (A.ll) 

Ay,  =  A-Qt  +  WiCl-^W^  Pi:P{In  -  r),  (A.12) 

AQ  =  A-TQf:,  (A.13) 

A„  =  A  -  SP  +  (/„  -  T)QtQUxCl-^  Uj,  (A.14) 

Rp  =  -Pa{P,^)Pi:P{In  -r)-  (In  -  rfP^pT  -  PW^Q-^W^ PEPil^  -  r),  (A.15) 

Rq  ^  -Qj{P,0)QtQ(In  -  rf  -  TQtQih  -  rf  -  QtQ{In  -  rf ,  (A.16) 

Rp  =  Pa(>,  ^)PEP(/„  -  r)  +  (/„  -  rf  PLPt  +  r^PEP  -  tQP,  (A.17) 

Rq  =  Ql{Ki)Q^QiIr.  -  rf  +  rQtQiln  -  rf  +  vQtQ  -  T.PQ,  (A.18) 

a(>,^)  ^  (.4.19) 

7(^,0)  =  UiCl-^U'^  -  +  UiQ-^U^,  (A.20) 

Vp  =  A'^P  -  (In  -  ^r)]'rpSPr,  (A.21) 

Ag-(/„-ir)Q£grT,  (A.22) 

Vp  ^  (A  +  gE)'^P  +  (/„  -  ir)]TpEPr,  (A.23) 

^  (A  -  tP)Q  +  (/„  -  \r)QtQr^.  (A.24) 
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Note  that  it  follows  from  (4.1)-(4.3), 


II 

1 

O 

B  =  Bf  —  Bq,  C  —  C  j  —  Co, 

(A.25) 

II 

-  Rifi.,  R2  =  R2.f  - 

(A.26) 

II 

1 

0 

II 

1 

0 

(A.27) 

t  =  -  BR;^R2B'^  +  BR^^ 

B'^,  t  =  C'^Vf^C  +  C'^Vf^V2C  +  C'^Vf^C. 

(A.28) 

Next,  differentiating  (4.17)  and  (4.18),  yields 

^  +  Wi  +  Wi  ,  {A.29) 

P  =  UiQU^  +  UihU^  +  Uim^ .  (/1.30) 

Furthermore,  differentiating  (4.23)  with  respect  to  A  gives 

0  =  UW+UW  =  Wi  +  Wi.  (>1.31) 

A. 2.  The  Correction  Equations 

The  correction  equations  are  developed  with  A  at  some  fixed  value,  say  A*.  The  derivation  of 
the  correction  equations  are  based  on  the  relationship  between  Newton’s  method  and  a  particular 
homotopy.  Below,  we  use  the  notation 

(A.32) 

Let  /  :  R"  — ►  R”  be  continuous  and  consider  the  equation 

0  =  fiO).  (>1.33) 

If  6^'^  is  the  current  approximation  to  the  solution  of  (A.33),  then  the  Newton  correction®®  A6  is 
given  by 

^(>+1)  _  ^(«)  ^  =  -/(^(‘^)-'e,  {AM) 

where 

e  =  f{e^'^).  (A.35) 

Now,  let  be  an  approximation  to  6  satisfying  (A.33).  Then  with  e  given  by  (A. 35)  construct 
the  following  homotopy  to  solve  (A.33) 

(l-/?)e  =  /(e(/3)),  ^€[0,1].  (A.36) 


23 


Note  that  at  /?  =  0,  (A.36)  has  solution  0(0)  =  6^'^  while  0(1)  satisfies  (A.33)-  Then  differentiating 
(A. 36)  with  respect  to  (3  gives 

||lc=o  = M-37) 

Remark  A.l.  Note  that  the  Newton  correction  A0  in  (A.34)  and  the  derivative  ^\p=o  in 
(A.37)  are  identical.  Hence,  the  Newton  correction  A0  can  be  found  by  constructing  a  homotopy 
of  the  form  (A.36)  and  solving  for  the  resulting  derivative  |||/3=o-  As  seen  below,  this  insight  is 
particularly  useful  when  deriving  Newton  corrections  for  equations  that  have  a  matrix  structure. 

Now,  we  use  the  insights  of  Remark  A.l  to  derive  the  equations  that  need  to  be  solved  for 
the  Newton  corrections  (AP,  AQ,  AP,  AQ),  or,  equivalently,  (AP,  AQ,  AH^i,  APi,  Afl).  We  be¬ 
gin  by  recalling  that  A  is  assumed  to  have  some  fixed  value,  say  A*.  Also,  it  is  assumed  that 

(P',  Q*, P*, 0*)  is  the  current  approximation  of  (P(A'),^5(A’),P(A*),Q(A“))  and  that  (Pp,pQ, 
Ep,  E^)  are  respectively  the  errors  in  equations  (4.5)— (4.8)  with  A  =  A"  and  (P(A),Q(A),P(A), 
<5(A))  replaced  by  {P‘ ,Q‘,  P‘ ,Q’),  respectively. 

Next,  we  form  the  homotopy 

(1  -  l3)Ep  =  A^Pil3)  +  P(/3)A  +  Pi  +  rT(/?)P(^)SP(/?)r(^) 

-  rT(/3)P(/3)SP(/?)  -  P(^)EP(/?)r(/3),  (A.38) 

(1  -  I3)Eq  =  AQiP)  +  Qi0)A'^  +  Fi  +  r(/3)Q(/3)EQ(^)r'r(/?) 

-  T{l3)Q{l3)tQi/3)  -  g(/?)Sg(/?)r'^(/S),  (A.39) 

(1  -  ^)Ep  =  {A-  Q{l3)EyPi(3)  +  P{0){A  -  Qi0)t)  -  r'r(/3)P(/3)EP(/?)r(/?) 

+  t'^{0)P{0)EP{0)  +  P(/?)SP(/3)r(/3),  (A.40) 

(1  -  0)EI  =  {A{0)  -  i:PmQ{0)  +  QmA  -  i:P{0)f  -  t{0)Q{0)E{0)Q{0)t'^{0) 

+  T{0)Q{0)t{0)Q{0)  +  Q{0)t[0)Q{0)T'^{0).  (A.41) 

Here,  (A,  E,  E,  Pi,  Vi)  =  (A(A*),  E(A’),  S(A*),  Pi(A*),  Vi(A*))  are  assumed  to  be  evaluated  at  A  = 
A*  and  at  ,5  =  0,  (P(0),g(0),P(0),g(0),r(0))  are  the  current  approximations.  Differentiating 
(A.38)-(A.41)  with  respect  to  /3,  noting  the  identity  of  (A.4)-(A.6)  with  f  now  representing 
and  using  Remark  A.l  to  make  the  replacements 

AP=fl.=o.  A<3a||„,.,  (4.42) 

yields 

0  =  A^AP  +  APAp  +  Pp(AP,AQ,AP,Ag)-f  P^(AP,Ag,AP,Ag)  +  £p,  (A.43) 
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0  =  AqAQ  +  AQAl  +  Rq{AP,AQ,AP,AQ)  +  Rl{APAQ,AP,AQ)  +  E’q,  {AAA) 

0  =  AlAP  +  APA^  +  Rp{AP,  AQ,  AP,  AQ)  +  AP,  AQ,  AP,  AQ)  +  E},,  {AA5) 

0  =  A^AQ  +  AQAl  +  Rq{AP,  AQ,  AP,  AQ)  +  Pj(AP,  AQ,  AP,  AQ)  +  VT,  {AA6) 

where 

Ap  =  A-  EPt,  (A.47) 

=  A  -  g£  +  WiQ-'^W^ P1:P{I„  -  r),  (A.48) 

AQ  =  A-TQt,  (A.49) 

A„  =  A  -  SP  +  (/„  -  T)QtQU^n-^Uj,  (A.50) 


Rp  =  -Pa{AP,  AQ)PT.P{In  -  t)  -  (/„  -  r)'^PSAPr  -  APWx^l-^W^ PEPiU  -  r),  (A.51) 
Rq  =  -Q'^{AP,AQ)QtQ{In  -  t)'^  -  rAg£Q(/„  -  r)^  -  AQUi^l-^U^QtQ{I„  -  rf,  (A.52) 


Rp  =  Pa(AP,  AQ)PEP{In  -  r)  +  (/„  -  r)'^Pi;APr  +  r'^PEAP  -  EAQP,  (A.53) 

Rq  =  QjiAP,AQ)QtQ{In  -  r)^  +  rAgEQ(/„  -  r)'^  +  rQEAQ  -  EAPQ,  (A.54) 

a{AP,AQ)  =  AVKifi-^iyT  -  +  Wia-'^AW^^W:^,  (A.55) 

7(AP,  aO)  =  -  Ui^-'^AnCl-'^U^  +  Pifi-^APT-  (>l-56) 


Next,  replacing  A  with  /?  in  (4.17),  (4.18),  and  (4.23)  and  differentiating  them  with  respect  to 
/?,  the  following  equations  are  derived, 


where 


AQ  =  +  WiAQW^  + 

AP  =  APiQ^f  +  UiAClU^  +  UjilAU^, 
0  =  AU^W^  +  UJAWu 


ATT  ^  I  A  TXT  ^  I  A  r\  ^  I 


(A.57) 

(A.58) 

(A.59) 


Appendix  B.  Efficient  Computation  of  the  Solution  to  the  Prediction  and  Correction 
Equations. 
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This  appendix  presents  a  solution  procedure  using  Ref.  21  for  efficiently  solving  the  prediction 
equations  (4.25)-(4.28)  and  the  correction  equations  (4.29)-(4.32).  We  commence  by  recognizing 
that  (4.25)-(4.28)  and  (4.29)-(4.32)  have  the  following  generic  form: 


0  =  AlP  +  PAp  +  Fa{P,  Q,  P,  Q)  +  Fp, 

(P.l) 

0  =  AqQ  +  QAI  +  Fb{P,  Q,  P,  i)  +  FQ, 

(P.2) 

0  =  AlP+PA,,  +  FciP,Qj,0)+Fp, 

(P.3) 

0  =  A,,^  +  ^Al  +  Fd(P,Q,P,^)  +  Fq, 

(P.4) 

where  the  linear  operators  Fa  :  S"’'",  Fb  :  ^  F^ 

and  Pd  :  X^S"’'"  3"=^",  are  defined  by 

.  ^4gnxn  _ ^ 

FaiP,  Q,  p,  =  Rp{P,Q,  >,  0)  +  Rl{P.  Q.  P,  h 

(P.5) 

Fb{P,  Q,  p,  i)  =  Rq{P,Q,  P,  i)  +  RliP,  Q,  >,  d), 

(P.6) 

Fa{P,  g,  >,  ^)  =  Rp{P,Q,  P,^)  +  R-liP,  g,  >,  h 

(P.7) 

Fd{P,Q,K^)  =  RQ{P,Q,K^)  +  RliP,Q,P,h 

(P.8) 

and  Fp^Fq^Ffip  and  Fq  are  constant  forcing  terms.  It  is  easy  to  verify  that  {P,Q,P,Q,FaiFi,,Fc, 
Fd,  Fp,  FQ,Fp,  Fq)  in  the  above  equations  represents  (P,  Q,  P,  Q,  Rp  +  Rp,  Rq  +  Rq,Rp  +  Rp, 
R^  +  Rl,Vp  +  Vj,VQ  +  V^,Vp  +  Vj^Vq  +  V7)  in  (4.25)-(4.28)  and  {AP,AQ,AP,AQ,R^p  + 
Rap^R^Q  +  Raq^RaP  +  ^Ip'^AQ  +  (‘^•29)-(4.32),  respectively.  Our 

goal  now  is  to  find  for  some  integer  m.  (as  small  as  possible)  linear  operators  (j>  :  R*^-, 

Ga  :  R'”-  Gb  :  R'”-  ^  S"""",  Gc  ■  R"'-  Gd  ■  R"-  S"’'",  such  that 

FaiP,Q,P,0)  =  Ga{4>{P,Q,hi)), 

Fb{P,Q,kd)  =  Gb{<i>{P,Q,Ki)), 

FoiP,Q,Ki)  =  Qc{4>iP,Q,P,^)), 

FdiP,Q,Ki)  =  Qd{<P{P,Q,K^)). 

Next,  define  the  following  linear  operators 

0i(>,O)  =  vect/To(>,0)PR,  (P.13) 


(P.9) 

(P.IO) 

(P.ll) 

(P.12) 
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(hiP)  =  vec  P, 

(5.14) 

4>3{P)  =  vec  PWiQ-^W^PB, 

(5.15) 

<^4(>,<^)  =  veciyT7(>,^)gC'^, 

(5.16) 

MQ)  =  vec  CQ, 

(5.17) 

<^6(^)  =  vec 

(5.18) 

and 

<?!>  =  I*;!*?  <f>3  <f>l  <f>l  <f>I 

(5.19) 

where 

a(>,0)  =  WiQ-'^W^  - 

(5.20) 

7(^,0)  = 

(5.21) 

are  given  by  (A. 19)  and  (A.20),  respectively.  It  follows  from  (B.13)-(B.18)  that  <?i>i(-)  G  R”*' 

,  hi') 

e  R'"^  (t>3{-)  e  6  R’”^  4>s{-)  e  R*"®,  Ai-)  e  R*"®,  and  <^(-)  e  R'”*where  mi  = 

Ticm,  m2  =  nm,  m3  =  nm,  m^  =  nc/,  ms  =  n/,  me  =  nl,  and 

6 

m,  =  ^  m,- =  (2n  +  nc)(’^  +  0-  (5.22) 

t=i 

Note  that  it  is  assumed  in  (B.20)  and  (B.21)  that  W^i,5^i,  and  are  obtained  from  (A.29)-(A.31). 
A  procedure  to  compute  Wi^  J7i,  and  tl  given  Q  and  P  is  presented  in  Appendix  C. 

Now,  note  that  (4.19)-(4.22)  imply  that 

C/TpFi  =  UJW2  =  0,  U'^W^  =0,  -  r  =  W.U^ .  (5.23) 

Thus,  using  (4.17)-(4.19)  and  (B.25),  we  can  rewrite  (A.15)-(A.18)  as 

Rp  =  Fa\  vec  ^(d'l)<Jal  +  Rai  VeC  ^{<t>2)Ga2  +  Fa3  VeC  ^{4>3)Ga3i  (5.24) 

Rq  =  Fb\  vec"^(<?!)4)6'6i  +  Fb2  vec~^ {(j)5)G b2  +  Fb3  y/ec~^{(j>e)Gb3,  (5.25) 

Rp  =  Fci  vec“^(d>i)Gci  +  Fc2  vec“'((^5)Gc2  +  Fc3  vec“^(</>2)Gc3  +  Fca  vec~^((p2)Gc4,  (5.26) 

Rq  =  Fdi  vec~'^ {(p4)G di  +  Fd2  vec"^(<^5)Gd2  +  5<i3  vec~^ {(f>5)G d3  +  Fd^  vQc~^{4>2)Gd4,  (5.27) 
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where 


Fal  =  -Uin,  Gal  =  RJ^B'^PW2UJ,  Fa2  =  -U2WjPBR2\  Ga2=W^U'^, 


Fa3  =  -Ir.,  Ga3  =  Ri'B'^PWiUj,  (B.28) 

ni  =  -VKiQ,  Gbx  =  Vf^CQU2W^,  Fb2  =  -W2U^QC'^Vf\  Gb2  =  UxW^, 

Ft3  =  Gb3  =  Vf^CQU2Wj,  (B.29) 

Fci  =  UxQ,  Gci=R2^B'^PW2UJ,  Fc2  =  -C^Vf\  Gc2  =  UxnuJ, 

F^  =  U2WjPBRi\  Gc3  =  WiU^,  Fci  =  UiW^PBR^\  Gc4  = /n,  (B.30) 

Fdi  =  W,Q,  Gdi  =  Vf^CQU2W^,  Fd2  =  W2U?QC"^Vi\  Gd2  =  0\w:^, 

Fd3  =  WjU^QC'^Vf\  Gd3  =  In,  Fd4  =  -BR^\  Gd4  =  Winw^.  (5.31) 
Next,  define  the  following  shaping  matrices 


^THi  —  [^mi  0]?  Em2  —  [0m2Xmi  -fm20]^  -^^m3  —  [Oma  x(m j +7712)  0], 

Etth  “  [0  Irui  0m4  x(m5  +  m6)]7  —  [0  Ims  OmsXme]?  -^^me  “  [0  -fmeli  (5,32) 

where  Em;  €  for  i  =  (1,2,.. .,6).  Now,  using  these  shaping  matrices,  we  define 


^01(2)  =  Fal  Vec"^(5TOjZ)(Sal  +  Fa2  {Ern^z)G a2  +  ■f’aS  Vec"^  (5TO32)G'a3, 

Sbi{z)  =  Fbi  vec~^{EmtZ)Gbi  +  Fb2  vec~'^{EmsZ)Gb2  +  Fbs  \ec~'^{Em^z)Gb3, 

Gcl{z)  =  Fc\  \eC~'^{Err,^z)Gc\  +  F^  VeC~'^  {Ejrt^z)G  c2  +  -^<=3  {E^^z)G  cZ 

+  Fc4  vec~^(f:„jZ)Gc4, 

Qd\{z)  =  Fd\  Vec”H-f^m,^)<^dl  +  Fd2  V&C~'^{Err,^z)Gd2  +  FdZ  V&C~'^{Em^z)Gd3 

■V  Fdi  v&z~'^{Em^z)Gd4,  (5.33) 


and 

Qa  =  Qa\  +  Q'1\,  Qh  =  Qb\  +  Qhi't  Oc  =  Gel  +  GJi^  Gd  =  Gdi  +  Gji-  (5.34) 
It  follows  from  (B.24)*-(B.27)  that  Qa^Gb^Gc^  stnd  Gd  satisfy  (B.9)--(B.12),  respectively. 


Now,  with  the  above  definitions,  the  solution  procedure  for  a  set  of  coupled,  modified  Lyapunov 
equations  described  in  Ref.  21  is  applied  to  solve  for  (5, <5,5,0)  in  (B.1)-(B.4).  With  the  above 
formulation,  the  efficiency  of  the  coupled  Lyapunov  equations  solver  is  realized  by  exploiting  the 
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low  rank  properties  of  the  coupling  terms.  In  particular,  to  solve  the  prediction  equations  (B.l)- 
(B.4),  the  primary  computational  burden  is  to  invert  a  matrix  of  m,  x  m,,  or,  equivalently,  (2n  + 
nc){'m+  1)  X  (2n  +  nc){m  +  /)  and  to  solve  four  sets  of  m.  +  1  standard  n  x  n  Lyapunov  equations, 
with  each  set  having  coefficient  matrix  of  Ap,Aq,Au„  and  A^,  respectively. 

In  comparison,  by  using  Kronecker  algebra®®,  (B.1)-(B.4)  can  be  converted  to  the  vector  form 
Ax  =  b  where  x  is  a  vector  consisting  of  the  independent  elements  of  P,Q,P  and  Q.  Hence,  to 
get  the  solution  for  {P,Q,P,Q),  it  requires  to  invert  an  2n(n  +  1)  x  2n(n  +  1)  matrix.  If  the 
rank  condition  (2.35)  is  observed,  that  is,  using  {Wi,Ui,Q.)  to  replace  {P,Q),  the  solution  would 
require  to  invert  a  matrix  of  dimension  n.  x  n.,  where  n.  =  n(n  +  +  1)  +  ndn  +1).  Thus,  if 

m  <<  n  and  /  <<  n,  which  is  usually  true,  then  m,  <<  n,  and  the  algorithm  discussed  in  this 
Appendix  will  be  much  more  efficient.  Furthermore,  if  (B.1)-(B.4)  are  first  transformed  to  the 
bases  in  which  Ap,Aq,Aw  and  A^  are  nearly  diagonal,  respectively,  the  cost  of  computation  can 
be  reduced  significantly. 

Next,  we  formulate  a  procedure  to  solve  the  derivative  equations  and  correction  equations  in 
a  desired  basis.  First,  let  Tp,Tq,Tu,  and  be  the  transformation  matrices  such  that  Tp^  ApTp, 

AqTq,T~^ A.ujT,ui  and  T~^AuTu  are  in  suitable  form  according  to  the  basis  option  described 
in  Section  4.4.  Next,  make  the  replacements 


Ap  <—  Tp^ ApTp,  Aq 


Tq^AqTq, 


rp-l  A  rp 


Au  <  Tu 


P^TjPTp,  Q^Tq^QTq'^, 
Fp^TjFpTp,  Fq^Tq^FqTq'^, 


P^T^PT^, 

Q  - 

F p  *—  T^F pTxjj, 

F^  - 

W2^T-^W2, 

Then  we  obtain 


4>x{P,Q)  =  vec  U^T-^TuU^a{P,Q)TlPB, 

(P.35) 

4>i{P)  =  vec  5'^Tp'^P, 

(P.36) 

4>z{P)  =  vec  TjPP, 

(P.37) 

M  'pM)  =  vec 

(P.38) 

4>h{Q)  =  vec  CTqQ, 

(P.39) 

MO)  =  vec  i>T^T-'^U,n-^U^T-^QC'^, 

(P.40) 
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and 


Fai  =  -TjT-'^Uin,  Gal  =  R^'B'^PTaWiU^T-^Tp,  Fa2  =  -TJt-'^U2WJt;^PBR^\ 

Ga2=Tp^T^W,U^TZ^Tp,  Fa^^-TjT-'^,  Ga3  =  R^'B'^  PTaW2U?T-^Tp, 

Fh  =  -TQ^TaW.Q,  Gti  =  Vi^CQTz'^U2WjT^TQ'^,  Ft2  =  -TQ^TuW2UjTZ^QC'^Vf\ 

Gi2  =  r^rjTt/i<r„%'^,  Fb3  =  -TQ^Ta,  Gw  = 

Fcl  =  t/lfi,  =  R2^B'^PTaW2Uj,  Fa2  =  Ge2  =  Qf/T, 

Fw  =  FjV^TrjFFFr',  Gw  =  Tp^TaWiU^ ,  Fa,  =  FiW^^rjFFFf',  Gw  = 

Fw  =  W,n,  Gw  =  K2-'GgT-'^F2W^2^,  Fw  =  W^2F7tj'GGTV2-\  Gw  =  T^T-'^UiW^, 

F,3  =  W,U^TZ^QC'^Vf\  Ga3  =  r^T-'^,  F^,  =  -T-^BR^\  G^  =Tp^TuW,£lWj , 

satisfying  (B.24)-(B.27)  in  the  new  basis. 

Appendix  C  Conversion  from  (Q,F)  to  {Wi,U\,tl) 

Note  that  the  following  procedure  is  valid  only  in  the  original  basis.  It  is  desired  to  compute 
1^1,  U\  and  Q  satisfying  (4.22)-(4.24).  Note  that  (4.12)  implies 

U^W2=Q,  (G.l) 


Pre-  and  post-multiplying  (4.22)  by  U  and  respectively  gives 


Q=]£i[Q  0]  + 


fi  0 
0  0 


+ 


(Iki)^, 


where 


U^w, 


]£j  =  UWi  = 

Similarly,  pre-  and  post-multiplying  (4.23)  by  W'^  and  W  respectively  gives 

P  =  Ui[^  0]  + 


Q  0 
0  0 


+ 


•  T 

Hi, 


(G.2) 


(C.3) 

(G.4) 


(G.5) 
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where 


P  4  W'^PW, 

'W^Ur' 

i  w'^Ui  = 

[w^Ui 


Partition  and  Ih  as 


It  then  follows  from  (C.4)  and  (C.7)-(C.9)  that  (4.24)  is  equivalent  to 

±11  =  -£u- 


(C.6) 

(C.7) 

(C.8) 

(C.9) 

(C.IO) 


It  now  follows  from  (C.8)  that  (C.2)  is  equivalent  to 

'4,  r±ii^  0]  \il  0]  rO(±nr 

=  +  + 

0  J  L±21^  oJ  [  0  oJ  [  0  0  _ 

and  from  (C.9)  that  (C.5)  is  equivalent  to 

'All  ihif]  0]  [fi  0]  \mxxf  fi(£2i)^' 

=  +  + 

.£21  0  J  L^2i^  oJ  [  0  oJ  L  0  0  _ 

Furthermore,  (C.ll)  is  equivalent  to 

Similarly,  equation  (C.12)  is  equivalent  to 

£11  =£iin  +  Q  +  fi(£„)'^, 

£21  =  ±1^^- 


(C.ll) 


(C.12) 


(C.13) 

(C.14) 


(C.15) 

(C.16) 
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Now,  (C.14)  and  (C.16)  imply  respectively  that 


(C.17) 

^21  =  P21^^~^- 

(C.18) 

Furthermore,  substituting  (C.IO)  into  (C.13)  yields 

(C.19) 

Denote  the  {i,j)  elements  of  Pu,  Oii>  and  Pu  respectively  by  p..,  q.^,  and  Then  we  can 
rewrite  (C.15)  and  (C.19)  as 


where 


+  6ijU>i+UiUji,  i,j  €  {1,2,..., rim}, 

lij-  ^ ’  I ,  J  €  { 1 ,  2 ,  .  .  . ,  nm  } , 

,  A  J  1  for  i  =  j 
{  0  for  i  /  j. 


(C.20) 

(C.21) 


(C.22) 


Next,  assume  i  =  j.  Then  subtracting  (C.21)  from  (C.20)  gives 


u,-,  = 


(C.23) 


Now,  assume  i  /  j.  Multiplying  (C.20)  by  [u>jfu>i)  and  adding  the  resultant  equations  to  (C.21) 
gives 


^itij  + 

u;2-a;2  ' 


Ui  7^  a.'j. 


(C.24a) 


or,  if  tv’,'  —  tv’j, 


(C.246) 


Now,  is  defined  by  (C.23)  and  (C.24)  and  by  (C.18).  }£ii  is  then  defined  by  (C.IO)  and 
by  (C.17).  ITj  and  Pj  are  now  defined  respectively  by  (C.8)  and  (C.9).  Using  (4.24)  it  follows 
from  (C.4)  and  (C.7)  that  Wi  and  U\  are  given  respectively  by 


3 

II 

ll 

(C.25) 

H 

II 

(C.26) 

From  (C.22)  it  follows  that 

-  2  ’ 

(C.27) 

which  defines  tl. 
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weighted  state  cost 


10° 


10‘ 


102 


unweighted  control  cost 


of  the  Performance  Curves  for  Various  Order  Con- 
ie 


Figure  5.6.  ||.P||f  as  a  Function  of  Control  Authority  *)  for  Four  Disk 

E.xample  with  He  =  4 


Figure  5.7.  ||Q||f  as  a  Function  of  Control  Authority  (gj  ’)  for  Four  Disk 

Example  with  =  4 


Figure  5.8.  ||.P||f  as  a  Function  of  Control  Authority  *)  for  Four  Disk 

Example  with  =  4 


xlO* 


Figure  5.9.  IIOIIf  as  a  Function  of  Control  Authority  Four  Disk 

Example  with  ric  =  4 
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Abstract 

A  new  majorant  robustness  analysis  test  that  yields  frequency  dependent  performance 
bounds  for  closed-loop  uncertain  vibrational  systems  with  frequency,  damping,  and  mode 
shape  uncertainties  is  developed.  Specifically,  for  closed-loop  systems  consisting  of  un¬ 
certain  positive  real  plants  in  series  with  sensor  and  actuator  dynamics  and  controlled  by 
strictly  positive  real  compensators,  performance  bounds  are  developed  by  decomposing  the 
equivalent  compensator  (which  includes  the  actuator  and  sensor  dynamics)  to  a  positive 
real  part  and  a  non-positive  real  part  and  using  concepts  of  M-matrices  and  majorant 
analysis. 

Key  Words:  Frequency  domain  performance  bounds,  robust  stability  and  perfor¬ 
mance,  majorant  bounds,  uncertain  vibrational  systems 

Running  Title:  Frequency  domain  performance  bounds 


This  research  was  supported  in  part  by  the  National  Science  Foundation  under 
Grant  ECS-9350181,  and  the  Air  Force  Office  of  Scientific  Research  under  Contract  F49620- 
92-C-0019. 


1.  Introduction 


The  analysis  of  uncertain  dynamical  systems  for  robust  stability  and  performance 
remains  one  of  the  most  important  issues  in  modern  feedback  control  theory.  This  ne¬ 
cessitates  the  development  of  efficient  analysis  tools  that  allow  a  control  system  to  be 
analyzed  for  robustness  with  respect  to  structured  and  unstructured  uncertainty  in  the 
design  model.  Hence,  considerable  effort  has  been  devoted  to  robust  analysis  in  the  recent 
years.  Many  of  the  developments  in  robust  analysis  have  focused  exclusively  on  stabil¬ 
ity  robustness  while  ignoring  robust  performance.  However,  it  is  well  known  that  robust 
performance  is  of  paramount  importance  in  practice.  Specifically,  even  though  stability 
robustness  addresses  the  qualitative  question  as  to  whether  or  not  a  system  remains  sta¬ 
ble  for  all  plant  perturbations  within  a  specified  class  of  uncertainties  it  is  important  to 
quantitatively  investigate  the  performance  degradation  within  the  region  of  robust  stabil¬ 
ity.  In  practice  it  is  often  desirable  to  determine  the  worst-case  performance  as  a  measure 
of  degradation.  The  interested  reader  is  referred  to  Bernstein  and  Haddad  (1990)  and  the 
references  therein  for  a  more  complete  exposition  of  the  robust  stability  and  performance 
analysis  problem. 

In  a  recent  paper  by  Hyland  et  al  (1994)  the  tools  of  majorant  analysis  used  to 
develop  robust  stability  and  performance  tests  in  Hyland  and  Bernstein  (1987),  Collins 
and  Hyland  (1989),  and  Hyland  and  Collins  (1989),  (1991)  were  extended  to  positive  real 
plants  controlled  by  strictly  positive  real  compensators.  Specifically,  using  the  logarithmic 
norm  in  the  context  of  majorant  analysis,  new  majorant  robustness  analysis  tests  were 
developed  that  yield  frequency  dependent  performance  bounds  for  frequency,  damping, 
and  mode  shape  uncertainty  in  positive  real  vibrational  systems.  For  this  class  of  systems 
the  positive  real  majorant  bounds  developed  in  Hyland  et  al.  (1994)  yield  much  less 
conservative  robustness  (stability  and  performance)  predictions  over  previous  norm  based 
majorant  performance  bounds  (Hyland  and  Collins,  1989)  and  the  performance  bound 
resulting  from  complex  structured  singular  value  analysis  (Hyland  et  al.,  1994,  Packard 
and  Doyle,  1993). 

The  main  purpose  of  this  paper  is  to  extend  the  results  presented  in  Hyland  et  al. 
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(1994)  to  uncertain  positive  real  structural  systems  in  series  with  actuator  and  sensor 
dynamics.  It  is  well  known  that  in  this  case  the  resulting  system  is  no  longer  positive  real 
and  hence  the  results  of  Hyland  ei  al.  (1994)  can  no  longer  be  applied.  Using  the  framework 
developed  in  Hyland  ei  al.  (1994)  we  develop  new  frequency  domain  performance  bounds 
for  this  more  general  class  of  uncertain  structural  systems.  Specifically,  the  results  are 
developed  by  decomposing  the  equivalent  compensator  consisting  of  the  original  strictly 
positive  real  compensator  along  with  the  actuator  and  sensor  dynamics  into  a  positive 
real  part  and  a  non-positive  real  part  and  using  the  concepts  of  M-matrices  and  majorant 
analysis.  To  demonstrate  the  effectiveness  of  the  proposed  approach  we  apply  our  results 
to  an  Euler-Bernoulli  beam  with  closely  spaced  frequency  uncertainty  and  actuator  and 
sensor  dynamics. 


Notation 


In  the  following  notation,  the  matrices  and  vectors  are  in  general  assumed  to  be  com¬ 


plex. 

IR 

(D 


Zxj  or  Zij 
diag{zi,...,zn} 

y  <<z 


det(Z) 

Iklb 

^min  ^max  {Z) 

p{Z) 

^min  {Z)  5  '^max  {Z) 

max{yi,...,y„} 

C[z{t)] 


set  of  real  numbers 

set  of  complex  numbers 

p  X  p  identity  matrix 

complex  conjugate  transpose  of  matrix  Z 

{i,j)  element  of  matrix  Z 

diagonal  matrix  with  listed  diagonal  elements 

Vij  <  for  each  i  and  j,  where  y  and  Z 

are  real  matrices  with  identical  dimensions 

absolute  value  of  complex  scalar  a 

determinant  of  square  matrix  Z 

Euclidean  norm  of  vector  x  (=  \/x^x) 

minimum,  maximum  singular  values  of  matrix  Z 

Probenius  norm  of  matrix  Z(=  (tiZZ^)^) 

spectral  radius  of  a  square  matrix  Z 

minimum,  maximum  eigenvalues  of  the  Hermitian  matrix  Z 
-  Y  where  =  max{yi,i; ,  y2,,j , . . . ,  yn.ij } 

Laplace  transform  of  z{t) 


2.  Mathematical  Preliminaries 


In  this  section  we  establish  several  definitions  and  two  key  lemmas.  A  nonnegative 
matrix  Z  is  a  matrix  with  nonnegative  elements,  i.e,  Z  >>  0.  A  block-norm  matrix 
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(Ostrowski,  1975)  is  a  nonnegative  matrix  each  of  whose  elements  is  the  norm  of  the 
corresponding  subblock  of  a  given  partitioned  matrix.  The  tnodulus  mcirii  of  .A  €  C 
is  the  m  X  n  nonnegative  matrix 

|a|m  =  [|ooI)-  (2->) 

Note  that  the  modulus  matrix  is  a  special  case  of  a  block  norm  matrix.  Let  B  € 
Subsequent  analysis  will  use  the  relation 

\AB\u  <<  |>1|m15|m.  (2-2) 

A  majorani  (Dahlquist,  1983)  is  an  element-by-element  upper  bound  for  a  modulus 
matrix  (or,  more  generally,  a  block  norm  matrix).  Specifically,  A  is  an  m  x  n  majorant  of 
A  E  if 

1A|m  <<  A.  (2.3) 

Let  Z  €  (C”^”.  Then  Z  E  is  an  n  x  n  minorant  (Dahlquist,  1983)  of  Z  if 

in  <  kit- 1,  (2-4a) 

i^j-  (2-46) 

The  following  lemma  is  a  direct  consequence  of  the  above  definitions. 

Lemma  2.1.  Let  Z^  and  Zod  denote,  respectively,  the  diagonal  and  off-diagonal 
components  of  Z  €  such  that 

Zd  =  diag{z,-.}-Li,  Zod  =  -  Zd-  (2.5) 

Then,  if  Zd  is  an  n  x  n  minorant  of  Zd  and  Zod  is  a  majorant  of  Zod,  Zd  —  Zod  is  a  minorant 

of  Z. 

A  matrix  P  E  is  an  M-matrix  (Fiedler  and  Ptak,  1962;  Seneta,  1973;  and 

Berman  and  Plemmons,  1979)  if  it  has  nonpositive  off-diagonal  elements  (i.e.,  Pij  <  0 
for  i  7^  j)  and  positive  principal  minors.  Recall  that  the  inverse  of  an  M-matrix  is  a 
nonnegative  matrix  (Fiedler  and  Ptak,  1962;  Seneta,  1973;  and  Berman  and  Plemmons, 
1979). 
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Lemma  2.2.(Dahlquist,  1983).  Assume  Z  €  and  let  Z  be  an  n  x  n  minorant  of 

Z.  If  in  addition  Z  is  an  M-matrix,  then  Z  is  nonsingular  and 

\Z-'^\m<<  (2-6) 

3.  Robust  Stability  and  Performance  for  Uncertain  Vibrational  Systems  with 
Actuator  and  Sensor  Dynamics 

We  begin  by  considering  the  following  n*^-order,  uncertain,  matrix  second-order  vi¬ 
brational  system  with  proportional  damping  and  rate  measurements: 


fj(t)  +  2AQ^{t)  -1-  =  Bu{t)  +  Dw{t),  (3.1a) 

y{t)  =  cm 
z(t)  =  Em 

where 

f)  =  diag{a}r=i.  i=l,2,...,n,  (3.2) 

A  =  diag{C.}r=i.  Ci>0,  1  =  1,2,.. .,n,  (3.3) 


u  6  IR”*  is  the  control  vector,  tv  €  01”“  is  the  disturbance  variable  or  reference  signal, 
y  e  ni”*-  represents  the  rate  measurements,  and  z  €  IR"'  represents  the  performance 
variables  (restricted  to  be  linear  functions  of  the  modal  rates).  It  is  assumed  that 


f2€n  =  {flo  +  Afi  :  (3-4) 

A€  A  =  {Ao  +  AA;  1AA1m<<  AA},  (3.5) 

B  €  B  =  {Ro  + AB  :  |AR1m  <<  ^}.  (3-6) 

D€D  =  {Do  +  AD:|AD1m<<^},  (3-7) 

C  G  C  =  {Co  +  AC  :  IACIm  <<  (3-8) 

B€E  =  {Bo  +  AB:1AB1m<<^}.  (3-9) 

Next,  define 

Bi  =  (fi,A),  (3.10) 

B2  =  (B,C),  (3.11) 

H3  =  {D,E),  (3.12) 
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and  define  Hi,  H2,  and  H3  to  be  the  corresponding  uncertainty  sets,  i.e.. 


Hi  =  €  n,  A  €  A}, 

(3.13) 

H2  =  {(B,C):BeB,  C€C}, 

(3.14) 

H3  =  {(A£^):-D€D,  EeE]. 

(3.15) 

Additionally,  define 

H  =  Hi  UH2UH3. 

(3.16) 

Note  that  Hi  is  the  uncertainty  set  corresponding  to  errors  in  the  frequencies  and  damping 

ratios  while  H2  and  H3  are  uncertainty  sets  corresponding  to  errors  in 
It  follows  from  (3.4)-(3.9)  that  Hi,  H2,  and  H3  are  arcwise  connnected 

the  mode  shapes. 

Furthermore,  let 

<11 

to 

(3.17) 

so  that  (3.1)  has  the  s-domain  representation 

=  Bu{s)  +  Dw{s), 

(3.18a) 

y{H,s)  =  Ce{s), 

(3.186) 

z{H,s):=Ee{s), 

(3.18c) 

where 

=  diag{(^i(Hi,s)}"^^, 

(3.19) 

and 

<i>,{Hus)-  +  2C, a-s  +  fir 

(3.20) 

Note  that  for  all  Hi  e  Hi,  ^{Hi,s)  is  strictly  positive  real,  so  that 

$(i/i,  jo))  +  $^(//i,iw)  >  0,  Jfi  €  Hi,  u;€(0,oo) 

(3.21) 

If,  alternatively,  the  system  is  undamped,  that  is,  C«  =  0.  ’  =  Ij-*- 

positive  real. 

,  n,  then  (3.19)  is 
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To  make  the  model  more  realistic  we  now  include  sensor  and  actuator  dynamics  that 
are  assumed  to  be  known.  These  dynamics  could  be  empirically  determined  via  hardware 
experimentation.  The  matrix  transfer  function  of  actuator  dynamics  (’i'a)  and  the  matrix 
transfer  function  of  sensor  dynamics  (^,)  are  given  by 

^o(s)^diag{^^a..(s))rJa,  (3.22) 

=  diag{^,,<(s)}”^j.  (3.23) 

Appending  these  dynamics  to  the  system  (3.18)  yields 

=  B'^a{s)u(s)  +  Dw{s),  (3.24a) 

y{H,s)  =  ^,(s)Ce{s),  (3.246) 

z{H,s)  =  Ee{s).  (3.24c) 

Next,  assume  that  the  linear  feedback  law 

u(s)  =  -K{s)y{s)  (3.25) 

stabilizes  the  nominal  system,  i.e.,  the  system  (3.24)  with  Hi  =  (floiAo)  and  H2  = 

(Bo, Co).  Furthermore,  assume  colocated  velocity  feedback  so  that  B  =  C'^.  Substituting 
(3.25)  into  (3.24a)  gives 


[^-HHi,s)  +  F{H2,s)]0{H,s)  =  Dw{s),  (3.26) 

where 

F{H2,s)  =  (3.27) 

Now,  define  Fpr(B^2)7'^)  to  be  the  positive  real  part  and  Bnpr(B2,>>)  to  be  the  non¬ 
positive  real  part  of  the  “equivalent”  compensator  F(B2,  jw),  respectively,  so  that 

F(/f2)  J^)  —  Fpr(i72,  JUj) -f  Fnpr(F2,  JO,’),  U’€(0,CXd),  (3.28) 
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where 


and 


Fpr(H2,JU^) 


10, 


otherwise, 


>  0, 


(3.29) 


F„p.(i/2,3a;)  ^  F{H2,Ju;)  -  Fp.(//2,>’). 


(3.30) 


for  all  a>  €  (0,oo),  Similarly,  define 

^  ,  -  A  r»{ju.),  A„|„  W>.)  +  4«(>.))  >  0, 

UprU^)  -  ^  otherwise, 

and 

’5'npr(>')  =  ^(>^)  -  ^pr(>'),  a;€(0,CX)). 


The  following  three  lemmas  are  key  to  the  development  of  the  robust  stability  and  perfor¬ 
mance  bounds  presented  in  this  paper. 

Lemma  3.1.  If  $(/fi,s)  is  strictly  postive  real  for  all  i/i  €  H  and  Fpr{H2,ju))  is 
given  by  (3.29)  then  [^>~^(i/i,>i^)  -I-  $“^(i/i,>>)]  -|-  [Fpr(F'2,>’)  +  F^(//2,>’)]  >  0  and 
hence 

-h  Fpr(i/2,>’)]  #0,  €  (0,co).  (3.31) 


Proof.  First  we  show  that  is  invertible  and  is  strictly  pos¬ 

itive  real.  Let  x  €  C”,  i  ^  0,  and  A  €  C  be  such  that  ^{Hi,ju>)x  =  Ax  and  hence 
x^^^{Hi,ju;)  —  A^x^.  Then  x^[<J'(F'i,>»)  -f  <lk»^(//’i,  jai)] x  >  0  implies  that  ReA  >  0. 
Hence  0.  Now  note  that 

which  implies  that  is  strictly  positive  real.  Next,  since  for  all  H2  €  H2, 

FpT{H2,ji*’)  +  Fp^{H2,j<^)  >  0  it  follows  that 

+  FpriH2,:t^)  4-  Fp«(F2,>»)  >  0, 

for  all  /fi,€  Hi  and  H2  €  H2.  Now  (3.31)  is  immediate.  □ 
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For  simplicity  of  exposition  we  define 


=  +  \  u;€(0,oo). 


(3.32) 


Furthermore,  define  5  :  IR  — ♦  IR  as 


a<0. 


The  next  two  lemmas  are  a  direct  consequence  of  Theorems  4.1  and  4.2  and  Theorems  6.1 
and  6.2  of  Hyland  ei  al.  (1994).  The  proofs  follow  from  majorant  analysis  and  standard 
singular  value  inequalities  and  hence  are  omitted. 

Lemma  3.2.  (Hyland  ei  ai,  1994).  If  is  given  by  (3.19)  and  Fpr{H2,juf)  is 

given  by  (3.29)  then 


where 


max|r(i/,>;)lM<<fo(>»), 

HeB. 


to{jU))  =p-'^(pj)Un, 


(3.33) 


p{ju)  =  max|m^in2(Co,ife  -  —  Af^jt) 


1 

+  2 


j^<S  (cTmin  (  5o  A/ ( Jo; )  )  ^max  (M(>.))|1AB||f) 

mm(— (fio.t  -  ASTi)*  -!.<)  -  i<Fm.x(*pr(>.’)  -  *?r(>'))('^m«(®o)  + 

k  UJ  ^ 

min(u?  —  — (flo.fc  +  Afljfc)  ’)  -  V(j“)  -  *?,(>’))(<^,n.x(B„)  +  IIABIIf)’}, 

k  (j)  ^  ) 

(3.34) 

V(>’)  +  »”(>’)  = 

and  Un  denotes  the  n  x  n  matrix  with  all  unity  elements. 

Lemma  3.3.  (Hyland  ei  ai,  1994).  Assume  ^{Hi,s)  is  given  by  (3.19)  and 
Fpt{H2,Ju})  is  given  by  (3.29)  and  let  Fd(/f2,jw)  and  Fod{H2,j^),  respectively,  denote 
the  diagonal  and  off-diagonal  matrices  corresponding  to  Fpt{H2,J<-^),  such  that 


F<i{H2,s)  =  diag{/pr,,i(//'2,s)}"^i, 
Fod{H2,s)  =  Fpr{H2,s)  -  Fd{H2,s). 
8 


(3.35) 

(3.36) 


Let  !!(>')  be  given  by 


n(>>)  =  P{ju>)  -  Fo<iM, 


(3.37) 


where  satisfies 


and 


P(ju>)  =  diag{ptib(>»)}”^j, 


(3.38) 


PJtib(.7^)  =max|2(Co,fc  -  ACjb)(fio,t  -  Afi*;) 

-  m 

^  /=: 


(3.39) 


min 

nen 


^0,]b 


—  u> 


1  ^  ^ 

^  /=1  ^ 


In  addition,  let  Fodiju^)  satisfying  (3.37)  be  given  by 

^  _  ,  _  , 

(f<xi(>’)k  =  <T„.x(  vc^'))  [E(i^».“  I + 

k=i  fc=l 

(3.40) 

Then,  if  !!(>>)  is  an  M-matrix, 


where 


max  ir(i7,>t>)|M  <<  fi(>>), 
i/gH 


fi(>>)  =  n-'(>;). 


Next,  define  f(^)  and  F^priju^)  such  that 


[r(>')]t;  =  niin([fo(>»)],;,[fi(;a> )],;),  w  €  (0,<x)),  (3.41) 


and 


max  |Fnpr(i72,>^)|M  <<  hpr{3<-^)- 


Now,  note  that  F^prij^)  is  given  by 


(3.42) 


[.fnpr(j'-*’)]tj  —  bji'^nprjki'jk, 

l=l  jt  =  l 
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and  |[FDpr(>')]o  l  <  [^npr(ju»)]o-  where  [Fnpr(>')]ij  is  given  by 

[Fnpr(>')]tj  =  O'inax(^npr(^))[y^XI-^0.«fcl  +  ’  E(I^Ojfc|  +  AB;t)^] 

k=l  k=l 

Next  we  present  the  main  result  of  this  paper  which  gives  robust  stability  and  perfor¬ 
mance  bounds  for  the  uncertain  vibrational  system  described  by  (3.24)  and  (3.25). 

Theorem  3.1.  The  dynamic  system  given  by  (3.24)  and  (3.25)  is  asymptotically 
stable  for  all  i/  €  H,  if 

p(f(ja;)Fnpr(>^))  <  1,  u;e(0,oo).  (3.43) 

Furthermore,  the  output  z{H,ju))  satisfies  the  bound 
max  \z{H,ju)\u  <<  lF|M[fn  -  r(>;)Fnpr(>^)]  ^f(>;)lZ)ii;(jw)|M,  ^  ^  (0,oo).  (3.44) 

Proof.  It  follows  from  the  multivariable  Nyquist  criterion  that  in  order  to  establish 
asymptotic  stability  of  the  closed-loop  uncertain  system  given  by  (3.24)  and  (3.25)  it 
suffices  to  show  that  det[$~^(ifi,yu>)  -f  F(/f2,ju>)]  0  for  all  w  €  (0,oo)  and  F  €  H. 

Using  the  definition  of  a  minorant  it  follows  that  I  —  r(^)Fnpr(>^)  is  a  minorant  of 
I  -4-  r(H,ju})FnpriH2,jt^)  for  all  Ff  G  H.  Now  (3.43)  implies  that  I  -  t(ju)Fnpr{j^)  is  an 
M-matrix.  Hence,  it  follows  from  Lemma  2.2  that  I  -f  T{H,ju})Fnpr{H2,j(jj)  is  invertible 
for  all  €  H  and  u>  G  (0,oo).  Futhermore,  since  by  Lemma  3.1  is  invertible  it 

follows  that 

+  F{H2,ju})]  =  det[/  +  r(Ff,>;)Fnpr(i/2,>’)]  det[r"^(i/i,  jw)]. 

Thus  det[$~^(F'i,jw)  -f  F{H2,P’)]  0  for  all  u>  G  (0,oo).  Now  the  performance  bound 

(3.44)  is  a  direct  consequence  of  (2.2),  (2.6),  and  (3.18c).  □ 

Remark  3.1.  Note  that  if  F{H2,s)  is  positive  real  then  the  spectral  radius  condition 
(3.43)  is  always  satisfied,  since  Fnpr(i?2)>^)  =  0  for  all  u  G  (0,oo).  Hence  Theorem  3.1 
predicts  unconditional  stability  for  all  uncertain  positive  real  plants  controlled  by  strictly 
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positive  real  compensators.  Furthermore,  in  this  case,  the  performance  bound  given  by 
(3.44)  collapses  to  the  performance  bound  obtained  in  Hyland  ti  al.  (1994). 

It  is  important  to  note  that  the  results  presented  in  this  section  are  not  restricted 
to  positive  real  plants  and  positive  real  compensators.  Specifically,  if  we  assume  that 
$“i(i/j,s)  is  not  positive  real  in  (3.26)  and  define  Gew,pT{H,ju})  and  G gw , ji*})  to  be 
the  positive  real  and  non-positive  real  parts,  respectively,  of  Gbw{H =  3*  -I- 

such  that 

^min  >  0 


and 

Gewynpr^F  ,JUf)  —  G$w(yF ,  juf)  Ggwypr^H 

for  all  u;  G  (0,  oo)  and  .H  G  H,  then  Theorem  3.1  holds  with  minor  modifications.  Note 
that,  in  this  case,  no  assumption  on  either  the  plant  or  the  compensator  is  required. 

4.  Illustrative  Numerical  Example 


In  order  to  demonstrate  the  effectiveness  of  the  proposed  approach  we  present  an 
illustrative  example.  Specifically,  consider  the  simply  supported  Euler-Bernoulli  beam 
with  governing  partial  differential  equation  for  the  transverse  deflection  u;(x,t)  given  by 


and  with  boundary  conditions 

iy(i,f)|x=o,L  =  0,  EI{x)^  |x=o,L  =  0, 

where  m(x)  is  mass  per  unit  length  and  EI{x)  is  the  flexural  rigidity  with  E  denoting 
Young’s  modulus  of  elasticity  and  I{x)  denoting  the  cross-sectional  area  moment  of  inertia 
about  an  axis  normal  to  the  plane  of  vibration  and  passing  through  the  center  of  the  cross- 
sectional  area.  Finally,  f{x,t)  is  the  force  distribution  due  to  control  actuation.  Assuming 
uniform  beam  properties,  the  modal  decomposition  of  this  system  has  the  form 

OO 

w(z.t)  =  J^W,(,x)qr(t), 
r=l 
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m 


fL 

/  mW^{x)dx  =  l,  ^r{x)  =  yJ~Bm'-j^,  r=l,2 . 

0 

where,  assuming  uniform  proportional  damping,  the  modal  coordinates  jr  satisfy 

9r(t)  +  2Cfir9r(0  d"  ^r9r(0  ~  [  f{x,t)Wr{x)dx,  r=l,2, - 

Jo 

For  simplicity  assume  L  —  tc  and  m  =  El  =  2/7r  so  that  yj —  1.  Furthermore,  we 
place  a  colocated  velocity /force  actuator  pair  at  i  =  0.55L.  Finally,  modeling  the  first  two 
modes  and  defining  the  plant  state  as  i  =  [gi  91  92  92F,  and  defining  the  performance  of 
the  beam  in  terms  of  the  velocity  at  i  =  0.7 L,  the  resulting  state  space  model  and  problem 
data  are 

x(t)  =  Ax{t)  +  Bu(t)  +  Diw{t), 
y{t)  =  Cx{t)  +  D2w{t), 


where 


^  =  block-diag^_j,, 


0 


1 


fi,-  =  1-2,  c  =  0.01, 


B  =  C'^  =  [0  0.9877  0  -0.309f  ,  Di  =  [B  O4X1],  D2  =  [0  1.9], 
with  the  performance  variables 


z{i)  =  Eix(t)  +  E2n{t), 


where 


El 


0  0.809  0  -0.951 

0  0  0  0 


E2  =  [0  1.9]'^. 


Using  Theorem  3.2  of  Haddad  ei  al.  (1994)  we  design  a  strictly  positive  real  compen¬ 
sator  K{s).  Next  we  assume  frequency  uncertainty  in  both  fii  and  ^2  with  =  0.5  and 
AQ2  =  0.4.  To  reflect  a  more  realistic  setting,  we  include  actuator  and  sensor  dynamics 
described  by 


^a(«)  = 


20 


20 


s  +  20’  s-f20’ 

Because  of  the  actuator  and  sensor  dynamics,  («)  is  positive  real  only  up 

to  O’  =  2.5  rad /sec  as  seen  in  Figure  1.  Hence  the  techniques  developed  in  Hyland  ei 
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al.  (1994)  for  generating  frequency  domain  performance  bounds  cannot  be  applied  here. 
For  the  assumed  uncertainty  range  the  complex  structured  singular  value  bound  bound) 
(Hyland  ei  ai,  1994;  Packard  and  Doyle,  1993)  and  the  complex  block-structured  majorant 
bound  (Hyland  and  Collins,  1991)  are  infinite  since  both  methods  predict  instability.  The 
proposed  majorant  bound  shown  in  Figure  2  gives  a  tight  finite  performance  bound. 

5.  Conclusion 

This  paper  developed  frequency  domain  performance  bounds  for  closed-loop  uncertain 
positive  real  vibrational  systems  controlled  by  strictly  positive  real  compensators  along 
with  appended  actuator  and  sensor  dynamics.  These  results  are  developed  by  using  prop¬ 
erties  of  logarthmic  norms  in  conjuction  with  majorant  analysis.  The  effectiveness  of  the 
proposed  approach  was  demonstrated  on  a  vibrational  uncertain  system  with  actuator  and 
sensor  dynamics. 
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Phase  (deg)  Gain  (dB) 


Frequency  (rad/s) 


Figure  2.  Performance  Bound  for  the  Euler-Bemoulli  Beam 
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